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Abstract 


For  years  there  has  been  a  steady  interest  in 
establishing  methods  for  automatically  translating  decision 
tables  to  programs  of  minimum  average  execution  time  or 
minimum  storage  requirement.  The  translation  algorithms  are 
divided  in  two  classes:  rule  mask  techniques,  which  we 
shall  discuss  only  incidentally,  and  methods  generating 
decision  trees  from  which  the  program  code  is  derived. 

We  shall  review  a  branch-and-bound  method  which  has 
been,  to  our  knowledge,  the  only  published  algorithm  which 
guarantees  the  optimality  of  the  derived  decision  tree.  We 
shall  discuss  some  of  the  heuristics  proposed  for  finding 
near-optimal  decision  trees  with  respect  to  average 
execution  time.  All  these  methods  generate  the  decision 
trees  proceding  from  the  root  to  the  leaves  and  thus 
considering  subtrees  of  decreasing  length. 

The  method  proposed  here  synthesizes  the  optimal 
decision  tree  by  considering  optimal  subtrees  of  increasing 
length,  applying  the  dynamic  programming  principle.  Whereas 
the  branch-and-bound  method  is  feasible  only  for  decision 
tables  with  up  to  five  conditions,  the  proposed  method 
converts  tables  with  up  to  eight  conditions  within  a  time 
comparable  to  that  of  heuristic  methods.  If  virtual  memory 
is  available  tables  with  up  to  twelve  conditions  can  be 
converted.  The  proposed  algorithm  handles  extended  entries 
as  well  as  limited  entries.  The  method  can  be  applied  for 
minimizing  the  total  storage  requirement  of  condition  tests 
and  actions  in  a  decision  tree  taking  advantage  of  hoisting 
actions  in  the  tree. 

An  implementation  of  the  algorithm  is  presented  in  the 
appendices. 
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1 . Pre limimaries 


1  • 1  Introduction 

The  interest  of  programmers  and  system  analysts  in 
decision  tables  seems  to  be  growing.  Not  only  are  decision 
tables  considered  a  valuable  means  for  man-to-man 
communication  but  they  also  facilitate  and  improve  the 
programming  of  decision  problems. 

Decision  tables  have  a  number  of  advantages  over 
flowcharts: 

•  decision  tables  are  easier  to  specify  and  to  read  in  case 
of  complex  decisions; 

•  the  documentation  is  inherent  in  the  table  itself; 

•  decision  tables  are  easier  to  modify; 

•  it  can  easily  be  checked  whether  all  possibilities  have 
been  covered  and  whether  the  table  is  redundant  or 
contains  contradictions; 

•  if  the  decision  table  is  translated  to  a  program 
automatically  by  a  preprocessor  of  a  compiler  the 
programmer  does  not  have  to  be  concerned  with  any 
optimization  of  the  resulting  program  as  this  also  can  be 
done  by  the  preprocessor. 

A  more  comprehensive  comparison  of  the  merits  of 
decision  tables  and  flowcharts  can  be  found  in  [Pooch74] 
which  is  an  introduction  to  decision  tables*  as  well  as*  for 
example*  [Humby73]  or  [  Pollack71a  ]. 
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1.2  Structure  of  Decision  Tables 
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Fig.  1.1  Example  of  a  decision  table  ([Pooch74]) 

A  decision  table  basically  is  divided  in  four  quadrants. 
The  upper  left  quadrant  is  called  condition  stub  containing 
all  conditions  being  examined  for  a  particular  problem.  In 
the  upper  right  quadrant  we  find  the  condition  entries.  A. 
column  of  condition  entries  is  called  a  rule.  The  condition 
entries  may  be  Y,  tf,  or  9-*.  The  entry  *-•  in  a  rule  means 
that  the  condition  in  that  line  is  irrelevant  for  this  rule. 

The  lower  left  quadrant  is  the  action  stub,  a  list  of 
actions  to  be  performed  for  any  of  the  rules.  The  action 
entries  in  the  lower  right  quadrant  specify  for  each  rule 
the  actions  to  be  performed.  In  general,  there  may  be 
several  actions  specified  for  a  rule.  If  the  sequence  in 
which  the  actions  are  to  be  performed  is  essential,  the 
action  entries  can  be  integers  instead  of  •X*. 

A  column  in  the  right  half  of  the  decision  table  should 
be  interpreted  as  an  IF-THEN-clause.  IF  the  results  of  the 
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relevant  conditions  match  with  the  condition  entries  of  this 
rule,  THEN  perform  the  actions  indicated  in  the  lower  half 
of  the  table.  It  is  generally  assumed  and  required  that  the 
condition  tests  are  not  dependent  on  each  other  and  so  the 
sequence  of  the  condition  tests  is  irrelevant. 

Often,  as  in  chapter  2,  we  are  not  concerned  with  the 
actions  in  detail.  Then  we  treat  the  actions  to  be  performed 
as  single  units  and  assign  to  different  sets  of  actions 
different  action  numbers  A[ j  ]  for  j>0.  We  will  denote  the  n 
conditions  as  C[  1  ]  to  C[n]. 

A  rule  which  does  not  contain  a  dash  entry  is  called  an 
elementary  (simple)  rule.  Rules  which  might  have  dash 
entries  are  combined  (mixed)  rules.  Decision  tables 
containing  only  elementary  rules  are  called  expanded  (full) 
tables  as  opposed  to  compressed  (partial)  tables. 

So  far  we  have  mentioned  only  so-called  limited  entries. 
If  we  have  multi-state  rather  than  Boolean  conditions  we 
speak  of  extended  entries.  A  decision  table  with  both  types 
of  conditions  is  said  to  be  of  mixed  entry  type. 


1 . 3  Redundancy, _ Incon sistency f  Completeness 


In  this  section  we  will  confine  ourselves  to  limited- 
entry  decision  tables.  The  discussion  for  extended-entry 
tables  is  similar,  but  more  cumbersome. 

Here  we  introduce  a  convention  which  will  be  very 
important  throughout  the  thesis.  To  each  elementary  rule  we 
assign  a  rule  number.  For  a  given  ordering  of  conditions, 
writing  a  0  for  N ,  1  for  Y,  the  rules  can  be  simply 
interpreted  as  a  binary  number.  We  call  this  number  the  rule 
number.  E.g.  rule  (1,0, 1,1)  has  rule  number  11.  For  n 
conditions,  we  have  rule  numbers  0  to  2**n-1  and  2**n 
elementary  rules.  Instead  of  "rule  with  rule  number  x"  we 
will  simply  say  "rule  x". 

Combined  rules  may  always  be  split  up  into  elementary 
rules.  For  example,  (1,-,-,1)  represents  the  set  of 
elementary  rules  {9,11,13,15}.  Rules  may  overlap,  i.e.  the 
intersection  of  the  set  of  elementary  rule  numbers  the  y 
represent  is  not  empty.  For  example,  ( 1 ,  — , 0)  or  {4,6} 
overlaps  with  (1,1,-)  or  {6,7}.  If  the  actions  associated 
with  overlapping  rules  are  identical,  we  say  that  we  have 
redundancy,  otherwise  the  decision  table  is  inconsistent. 

Often  not  all  conditions  are  independent  of  each  other, 
thus  some  of  the  entries  in  a  rule  may  be  implied  by  the 
other  entries  in  this  rule.  It  is  common  practice  to 
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indicate  implied  negative  entries  by  *,  (N) ,  or  N*  and 

implied  positive  entries  by  $,  (Y) ,  or  Y*  [Pollack71a, 

King69,  Verhelst72].  Taking  the  opposite  value  of  an 
implied  entry  yields  a  logically  impossible  rule.  Rules  with 
implied  entries  can  be  said  to  be  combined  rules,  too,  as 
they  implicitly  define  more  than  one  elementary  rule. 

A  decision  table  is  complete  if  all  elementary  rules  are 
specified  in  the  decision  table  either  explicitly,  or 
implicitly  by  combined  rules.  fiore  clearly,  we  can  define 
three  subsets  A,  B,  C  of  the  set  of  elementary  rules: 

®  A  is  the  set  of  all  elementary  rules  for  which  an  action 
is  defined.  Each  specified  (combined  or  elementary)  rule 
represents  a  set  of  elementary  rules  the  union  of  which  is 
the  set  A.  If  the  decision  table  is  to  be  non-redundant 
and  consistent  these  sets  of  elementary  rules  have  to  be 
dis  joint . 

®  B  is  the  set  of  all  elementary  rules  which  are  implicitly 
defined  as  logically  impossible.  Each  combined  rule 
containing  an  implied  entry  specifies  a  set  of  elementary 
rules  which  are  logically  impossible.  These  sets  need  not 
be  disjoint.  B  is  the  union  of  these  sets  and  might  be 
empty. 

»  C  is  the  set  of  elementary  rules  that  are  neither  in  A  nor 
B.  If  C  is  empty  we  say  the  decision  table  is  complete . 


As  an  example  see  Fig.  1.2. 
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I  C[  1  ]  j  N  |  N  |  Y 

|  C[  2  ]  |  N  |  Y  !  Y* 

(  C[3]  !  N*  j  -  |  Y 

i - - - 


I  A[1]|  A[2]|  A[3] 


set  A:  {0,2,3, 7} 
set  B:  {1,5} 
set  C:  {4,6} 


Fig.  1.2  Example  of  an  incomplete  decision 
table  with  logically  impossible  rules 


if  C  is  not  empty  there  are  generally  two  ways  of 
handling  these  rules  depending  on  the  intention  of  the  user. 

(1)  The  applicability  of  one  of  these  rules  is  considered  as 
an  error.  The  probability  of  the  occurence  of  these 
errors  is  very  low,  so  the  user  wants  to  branch  to  a 
standard  error  routine  in  these  cases.  This  convention 
is  called  "ELSE  rule  test". 

(2)  The  rules  are  logically  impossible.  This  convention  is 
referred  to  as  "No  ELSE  rule  test". 

Note  that  in  case  of  "No  ELSE  rule  test"  there  is  no 
difference  between  sets  B  and  C.  Both  sets  comprise 
logically  impossible  rules.  Thus,  if  we  do  not  test  the  ELSE 
rule,  we  can  omit  stars  in  the  decision  table  without 
changing  the  logic. 

Throughout  this  thesis  we  will  use  the  following 
convention : 

•  the  Else  rules  will  be  indicated  by  a  unique  action  number 


A[i],  i>0,  which  is  not  used  otherwise; 
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•  the  logically  impossible  rules  will  be  identified  by  an 
action  A[  - 1  ]. 


[  0  I  1  I  2  |  3  |  4  I  5  §  6  J  7 

f - — 8  — - - - - — - — - - - - - - 1 

SC[1]|NSN1NSNIY1Y1Y|Y1 
8C[2]§  N  J  N  jj  Y  1  Y  8N  J  N  |  Y  j  Y  J 

|C[3]|  N  f  Y1  N  |  Y  |  N  |  Y  |  N  jj  Y  | 

a - - — ,  — - - — — - — - - - — - — - - — - — — ■ - — — - - — - - | 

I  A[1]|A[-1]|  A[  2  IS  A[2]f  A[  4  ]  |  A[  -  1  J  f  A[  4  ]  f  A[  3  ]  § 

( — - - - - - — . — _ — - - - — - — . — — — — _ _ _ _ _ i 

Fig.  1.3  Expanded  form  of  decision  table 

in  Fig.  1 . 2 


Fig.  1.3  is  the  expanded  form  of  the  decision  table  in 
Fig.  1.2  on  the  assumption  that  we  want  to  test  the  ELSE 
rule.  If  we  do  not  test  the  ELSE  rule*,  rules  4  and  6  would 
also  be  assigned  action  A[-1]. 


1 . 4  Processing  of  Decision  Tables  using  Rule  Mask  Techniques 


When  processing  a  decision  table  we  have  to  isolate  the 
rule  that  is  applicable  under  a  given  set  of  condition 
values.  Basically  the  methods  of  processing  a  decision 
table  are  divided  in  two  classes:  the  so-called  rule  mask 
techniques  and  the  conversion  to  decision  trees.  Before  we 
consider  only  decision  trees  for  the  rest  of  the  thesis,  we 
will  give  a  short  description  of  a  rule  mask  algorithm 
[Kirk65]  for  a  limited-entry  decision  table. 
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The  entries  in  a  limited-entry  decision  table  are 
ternary.  If  we  want  to  represent  the  decision  table  in 
binary  logic,  we  have  to  use  two  bits  for  each  entry.  One 
way  is,  for  example,  to  use  one  bit  to  indicate  whether  the 
entry  is  a  dash  (0)  or  not  (1) ,  the  other  bit  to  indicate 
whether  the  entry  is  a  Y.  Thus  we  get  a  mask  matrix  and  a 
table  matrix.  For  the  decision  table  of  Fig.  1.1  we  get: 

mask  matrix:  r - - , 

I  C[  1  ]  |  1  1  1  If 

1  C[  2  ]  \  0  1  1  If 

|  C[3]  S  0  0  1  If 

s _ _ _ _ _ g 

table  matrix:  r - - - - — a 

i  C[  1  ]  |  1  0  0  Of 

|  C[  2  ]  J  0  1  0  os 

I  C[3]  J  0  0  1  os 

i _ c 

Fig.  1.4  Mask  matrix  and  table  matrix  for 
decision  table  in  Fig.  1.1 

The  actual  processing  of  the  decision  table  is  done  in 
the  following  way.  A  binary  transaction  vector  is  built  by 
placing  a  s1®  in  each  true  condition  position  and  a  'O'  in 
all  other  positions.  The  conjunction  of  this  vector  with 
the  first  rule  column  of  the  mask  matrix  is  built  and 
compared  with  the  first  column  of  the  table  matrix.  The 
conjunction  filters  out  all  non-pertinent  entries.  The 
comparison  with  the  table  matrix  shows  whether  the  pertinent 
Y-entries  match.  If  they  do  not  match,  the  conjunction  and 
comparison  is  repeated  for  the  second  column  and  so  on.  If 
the  decision  table  is  complete  we  will  certainly  find  a  rule 


-9- 


which  corresponds  to  the  actual  conditions.  If  the  decision 
table  is  redundant  or  inconsistent,  we  might  even  find  more 
than  one  rule.  As  the  scanning  process  is  very  fast, 
[ Muthukrishnan70 ]  suggested  that  the  check  for  redundancies 
and  inconsistencies  should  be  performed  during  the 
processing  of  the  tables.  [King73]  and  [PollackTI]  reject 
this  view  and  emphasize  the  necessity  for  this  checking 
during  the  parsing  of  the  decision  table. 

If  in  our  example  C[ 1  ]  is  false  and  C[ 2  ]  and  C[ 3  ]  are 
true,  the  transaction  vector  will  be  (0,1,1),  and  the  second 
rule  will  be  selected. 

When  selecting  a  method  for  processing  decision  tables, 
the  objectives  are,  as  usual,  the  minimization  of  the 
storage  requirements  for  the  object  program,  or,  more 
important,  the  minimization  of  the  average  execution  time. 
In  terms  of  storage  requirements  the  rule  mask  technique  is 
very  efficient.  Each  test  need  appear  only  once  in  the 
program,  and  the  storage  needed  for  the  matrices  and  for  the 
interpreting  process  can  be  regarded  as  quite  small. 
However,  with  respect  to  average  processing  time,  rhis 
approach  is  not  efficient.  All  conditions  have  to  be  tested 
once,  and  the  interpreting  process  requires  additional  time. 
[King66]  suggested  the  interrupted  rule  mask  technique  which 
can  improve  the  execution  time  to  a  certain  extent.  If  we 
have  a  look  at  our  example,  we  can  see  that  in  case  of  a 
true  C[  1  ]  we  do  not  need  to  test  C[  2  ]  and  C[  3  ].  Similarly 
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we  do  not  have  to  test  condition  C[ 3  ]  for  the  second  rule. 
With  the  interrupted  rule  mask  technique  we  do  not  build  the 
complete  transaction  vector  at  once,  rather  we  test  as  many 
additional  conditions  as  we  need  for  the  next  column  in  the 
mask  matrix. 

Certainly  we  can  exchange  rows  and  columns  in  a  decision 
table  without  changing  the  logic.  Rearranging  the  rules  and 
conditions  will  change  the  average  execution  time  using  the 
interrupted  rule  mask  technique.  In  order  to  find  a 
strategy  for  an  optimal  arrangement  of  rules  and  conditions, 
we  need  additional  information.  The  user  is  required  to 
estimate  the  testing  time  for  each  condition  and  the 
probability  that  each  rule  will  be  found  applicable. 

Often  it  is  not  easy  to  estimate  the  probabilities  of 
the  rules.  Thus  it  has  been  suggested  [Press65]  that  during 
the  processing  of  decision  tables,  the  frequency  of 
applicability  of  each  rule  should  be  counted  and  some 
statistical  data  should  be  given  to  the  user.  The 
information  gathered  could  be  used  when  translating  the 
decision  table  of  the  same  problem  again. 

Knowing  the  testing  time  for  each  condition,  we  can 
calculate  the  total  time  needed  for  testing  the  pertinent 
conditions  of  a  rule.  Reasonable  choices  for  the  first  rule 
to  test  would  be  either  the  rule  with  the  lowest  total 
testing  time  or  the  rule  with  highest  probability  of 
occurrence  assuming  it  does  not  require  the  testing  of  all 
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conditions.  As  there  obviously  might  be  a  trade-off  between 
the  two  ways.  King  suggested  four  different  strategies  for 
the  arrangement  of  the  rules  and  conditions. 

The  execution  time  of  rule  mask  techniques  cannot  be 
improved  beyond  a  certain  point.  After  having  introduced 
the  notion  of  the  decision  tree  we  will  give  a  lower  bound 
for  the  average  execution  time  of  the  interrupted  rule  mask 
technique.  This  bound  is  never  lower  and  is  usually 
substantially  higher  than  the  optimum  average  execution  time 
achieved  with  decision  trees. 


1 . 5  Conversion  to  Decision  Trees 

In  the  last  section  we  briefly  discussed  rule  mask 
techniques.  The  alternate  way  of  processing  decision  tables 
is  the  conversion  to  decision  trees  (flowcharts,  sequential 
testing  procedures) .  A  decision  tree  in  general  is  a 
multiple- branch  tree.  If  we  confine  ourselves  again  to 
limited-entry  tables,  the  decision  tree  equivalent  to  the 
decision  table  is  a  binary  tree  labelled  with  conditions. 
In  each  path  of  the  tree  each  condition  appears  at  most 
once.  Throughout  the  thesis  we  will  use  the  convention  that 
the  left  (right)  branch  of  a  node  is  to  be  continued  in  case 
of  a  FALSE  (TRUE)  condition. 

A  complete  (full)  decision  tree  is  a  tree  where  all 
paths  have  length  n  if  there  are  n  conditions. 


Then  each 
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elementary  rule  of  the  decision  table  corresponds  to  exactly 
one  path  of  length  n  in  the  tree.  As  the  leaves  of  the  tree 
we  add  the  actions  which  are  associated  with  the 
corresponding  elementary  rules.  We  can  number  the  leaves  of 
the  tree  in  the  same  way  as  we  numbered  the  rules  of  the 
decision  table.  The  leftmost  leaf  has  number  0  as  all 
conditions  are  FALSE  in  this  case,  the  rightmost  leaf  has 
number  2**n-1.  The  numbers  of  all  other  leaves  depend  on 
the  arrangement  of  the  conditions  in  the  tree.  Each 
complete  tree  coreesponds  to  the  (2**n) -tuple  of  numbers 
attached  to  the  leaves.  Of  course,  not  all  permutations  of 
the  (2**n) -tuple  represent  a  tree. 


t - « 

f  prob. :  0.4  0.2  0.1  0.3  f  cost : { 
i - - - 8 

i  c[  i  ]  s  y  N  N  N  |  3  1 

I  C[2]  8  -  Y  N  N  |  5  8 

I  C[3]  8  -  Y  N  §  2  | 

6 - , - , - » 

5  H  1  ]  A[  2  ]  A[  3  ]  A[  4  ]  \ 

i _ i 


Fig.  1.5  Example  of  a  decision  table 
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1  1 

a - Cf  2  ] - s  i - C[2] - , 

118  8 
f - C[  3  ] - ,  e - C[  3  ] - ,  f - C[  3  ] - ,  g - C£  3  ] - 8 

f  I  1  i  1  1  I  8 

i  11  if  18  8 

A[  4  ]  A[  3  ]  A[  2  ]  A[  2  ]  A[  1  ]  A[  1  ]  A[  1  ]  A[  1  ] 
{0}  {1}  {2}  {3}  {4}  {5}  {6}  {7} 

Fig.  1.6  Complete  decision  tree 
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Fig,  1.6  shows  one  possible  complete  decision  tree 
representing  the  decision  table  in  Fig.  1.5  (the 
probabilities  and  costs  added  in  Fig.  1.5  will  be  needed 
later  in  this  section) .  The  leaf  numbers  {0}  to  {7}  are 
assigned  according  to  our  convention  for  the  rule  numbers. 
Rules  differing  only  in  C[ 1 ],  C[2],  or  C[ 3 ]  have  a 
difference  in  its  rule  number  of  4,  2,  or  1  respectively. 

N 

If  on  the  other  hand  a  tree  is  represented  as  an  n-tuple  of 
rule  numbers,  we  can  easily  reconstruct  the  tree.  Consider 
for  example  (0,2, 4,6, 1 ,5, 3,7) •  Building  the  natural  order 
of  the  left  four  rule  numbers  and  of  the  right  four  rule 
numbers,  corresponding  elements  of  both  ordered  sets  differ 
all  in  1.  Thus  C[ 3 ]  is  the  root  of  the  tree.  It  is 
sufficient  to  consider  the  difference  of  the  leftmost 
numbers  in  the  tuples  because  the  leftmost  number  is  always 
the  smallest  of  the  tuple.  The  difference  between  the  first 
two  pairs  of  rule  numbers  and  the  third  and  fourth  pairs  is 
4  and  2,  respectively,  thus  having  C[ 1  ]  at  the  NO-branch  of 
C[  3 ]  and  C[  2  ]  at  the  YES-branch  of  C[3].  The  lowest  level 
of  the  tree  is  determined  by  the  missing  condition  in  each 
path.  Certainly  the  representation  as  a  (2**n) -tuple  is 
highly  redundant,  but  it  is  quite  effective  as  we  will  see 
later  on.  Fig.  1.7  shows  the  resulting  tree  of  this 


example. 
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Fig.  1.7  Rearranged  complete  decision  tree 

of  Fig.  1.6 


The  exponential  growth  of  the  number  of  complete  trees 
with  the  number  of  conditions  n  is  quite  impressive.  Let 
f (n)  be  the  number  of  possible  trees  with  n  conditions. 
Adding  an  (n  +  1)-st  condition  on  top  of  two  subtrees  of 
length  n  and  considering  that  any  of  the  n+1  conditions 
might  be  the  root  of  the  tree,  we  get  f (n+ 1)  =  (n* 1) *f 2  (n) 
[Huaby73].  The  approximate  values  for  n<8  are  listed  in  the 
following  table. 


n  l 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

! 

i 

f  (n)  I 

1 

2 

12 

576 

IQ®- 

10*3 

1027 

loss 

IQiii. 

10224 

i 

S 

Fig.  1.8  Approximate  number  of  decision  trees 


The  average  weighted  external  path  length  of  a  tree 
[Knuth68]  gives  us  the  average  execution  time  of  the 
decision  tree.  The  expected  time  needed  for  testing  each 
condition  (in  the  following  simply  called  the  (average) 
execution  time)  must  be  known  together  with  the  probability 
of  each  rule.  The  time  needed  to  reach  a  leaf  is  the  sum  of 
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the  testing  times  of  the  conditions  on  the  path  leading  to 
that  leaf.  The  average  execution  time  is  thus  the  sum  of 
the  times  to  reach  the  leaves  weighted  by  their  probability. 

For  a  while  we  will  identify  the  cost  of  the  tree  with 
its  average  execution  time.  Thus  the  cost  of  all  possible 
complete  trees  equals  the  sum  of  the  testing  times  of  all 
conditions,  which  is  the  maximal,  worst  case  cost.  We  can 
lower  the  cost  of  the  tree  if  we  can  replace  subtrees  by 
leaves  thus  reducing  seme  of  the  paths*  lengths.  We  can 
replace  a  subtree  by  a  leaf  if  each  of  the  rules  comprised 
by  the  subtree  which  do  not  have  A[-1],  has  the  same  action 
A[i]r  for  any  i>0.  In  this  case  we  can  stop  the  process  of 
isolating  the  rules  before  having  tested  all  of  the  n 
conditions.  We  can  assign  a  probability  p  to  the  leaf 
representing  the  subtree  which  equals  the  sum  of  the 
probabilities  of  the  rules  comprised  by  the  subtree.  It  is 
easy  to  see  that  the  gain  achieved  is  the  product  of 
probability  p  and  the  sum  of  the  testing  times  of  the 
conditions  no  longer  tested,  i.e.  the  conditions  in  the 


subtree. 
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P[  0 . 4  ] 
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Fig.  1.9  Decision  tree  derived  from  tree 

in  Fig.  1.6 


Fig.  1.9  shows  the  tree  obtained  when  replacing  subtrees 
by  leaves.  The  cost  of  the  complete  tree  was  10.0.  Here  we 
save  testing  of  conditions  C[3]  with  probability  0.2  and 
C[2]  and  C[ 3 ]  with  probability  0.4.  Denoting  the  testing 
times  of  condition  C[i]  with  t[i],  we  have  a  total  gain  of 
t[3]*0.2  +  t[2]*0.4  ♦  t[3]*0.4.  With  the  values  in  Fig.  1.5 
this  sum  equals  3.2,  thus  the  total  cost  of  the  tree  in  Fig. 
1.9  is  10.0  -  3.2  =  6.8. 


The  tree  in  Fig.  1.9  is  a  special  case  in  that  the  four 
paths  correspond  exactly  to  the  combined  rules  of  the 
decision  table  in  Fig.  1.5.  In  this  case  the  probabilities 
of  the  paths  are  given  by  the  combined  rules.  In  general, 
however,  there  is  no  correspondence  between  the  combined 
rules  in  the  decision  table  and  the  paths  in  the  tree.  In 
this  case  the  probabilities  of  elementary  rules  must  be 
known  in  order  to  calculate  the  average  testing  time  of  the 
tree.  Usually  the  convention  has  been  adopted  to  split  up 
the  probability  of  a  combined  rule  equally  among  the 
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elementary  rules  represented  by  the  combined  rule 
[Reinwald66,  Ganapathy72,  Verhelst72]. 

Two  comments  are  in  order  at  this  point.  First,  we  must 
require  the  decision  table  to  be  non-redundant,  otherwise 
the  probability  assigned  to  an  elementary  rule  which  is  part 
of  two  combined  rules,  might  be  ambiguous.  ¥e  consider  for 
the  rest  of  the  thesis  only  non-redundant  and  consistent 
decision  tables. 


The  other  comment  is  connected  with  an  objection 
expressed  in  [King74],  In  practice  the  probabilities  of  the 
elementary  rules  composing  a  combined  rule  are  usually  not 
equal.  Consider  for  example  the  elementary  rules  in  Fig. 
1 . 10 (a)  . 


Y  I  I 
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A[  1  ] 

P[0.  1  ] 
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P[  0.  4  ] 


AC  1  ] 

P[  0. 2  ] 


AC  1] 

P[ 0.5  ] 


A[  1] 

P[0.2] 


A[  1  ]  A[1  ] 

P[  0 . 1  ]  P[  0 . 6  ] 


(a) 


(b) 


Fig.  1.10  Different  ways  of  combining 
elementary  rules 


(c) 


Assuming  identical  actions  for  the  rules.  Fig.  1.10(b) 
and  (c)  represent  the  same  rules  using  a  combined  rule. 
Splitting  up  the  probabilities  yields  (0.25,0.25,0.2)  and 
(0. 1 , 0. 3, 0. 3)  as  opposed  to  (0. 1 , 0.  4,  0.  2)  in  (a).  The  data 
used  for  optimization  of  the  tree  do  not  match  with  the  real 


( 
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problem.  Hence  in  general  we  will  not  find  the  real 
optimum. 

Although  it  is  necessary  to  know  the  probabilities  of 
the  elementary  rules  in  order  to  find  the  real  optimum, 
often  only  the  probabilities  of  the  combined  rules  are  known 
and  it  is  desirable  to  keep  the  number  of  rules  small.  In 
the  case  of  combined  rules  the  optimum  is  sought  under  the 
convention  that  the  probabilities  are  split  up  equally  among 
the  elementary  rules  comprising  each  combined  rule.  If  the 
user  wants  truly  optimal  conversion  and  the  probabilities  of 
the  elementary  rules  can  be  provided,  he  should  specify 
elementary  rules. 

With  this  convention  we  can  calculate  the  average 
execution  time  of  the  tree  in  Fig.  1.7.  Combining  rules  {4} 
and  {6}  and  assigning  to  each  node  of  the  tree  the 
probability  with  which  a  condition  test  has  to  be  done,  we 
get  the  tree  in  Fig.  1.11.  The  gain  achieved  by  combining 
rules  {4}  and  {6}  is  1.0,  thus  the  cost  is  9.0. 
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Fig .  1,11  Probabilities  attached  to  the 

tests  in  tree  in  Fig.  1.7 


condition 


We  return  now  to  the  question  of  finding  a  lower  bound 
for  the  execution  time  of  the  interrupted  rule  mask 
technique.  We  will  consider  restricted  decision  trees  which 
have  the  same  condition  on  each  level  of  the  tree#  i.e.  for 
each  path  we  have  the  same  sequence  of  condition  tests. 
There  are  only  nS  of  these  trees.  For  example#  for  n=6 
conditions  there  are  720  restricted  trees  as  opposed  to 
roughly  IQ*3  trees  without  this  property.  Starting  with  the 
complete  restricted  tree  which  corresponds  to  this  testing 
sequence#  we  can  reduce  the  cost  by  pruning  some  of  the 
branches.  We  can  stop  following  a  testing  sequence  if  all 
the  conditions  not  yet  tested  are  irrelevant  to  the  action 
chosen.  The  cost  of  the  best  restricted  tree  is  a  lower 
bound  on  the  cost  attainable  by  the  interrupted  rule  mask 
technique  since  one  of  the  nl  testing  sequences  is  chosen. 
For  example#  consider  the  following  mask  matrix. 
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Fig.  1.12  Example  of  a  mask  matrix 

The  rectangles  in  the  Fig.  1.12  indicate  the  subtrees 
which  can  be  cut  cut  of  the  originally  complete  restricted 


decision 

tree . 

For  each  of 

the  rules 

the 

number  of 

conditions  to  be 

tested  is  the 

same 

for 

the 

restricted 

decision 

tree  and 

the  interrupted 

rule 

mask 

technique.  Thus 

the  costs 

of  the 

two  approaches  are  the 

same 

if 

we  ignore 

t he  overhead  caused  by  the  interpretation  of  the  mask 
matrix. 

In  general,  the  optimal  decision  tree  has  substantially 
lower  cost  than  the  best  restricted  tree.  Also,  if  some  of 
the  actions  defined  for  the  combined  rules  specified  are 
identical,  this  might  lead  to  additional  gains  with  decision 
trees,  whereas  the  cost  of  the  rule  mask  technique  does  not 
improve. 

As  mentioned  in  the  previous  chapter,  the  rule  mask 
techniques  are  very  efficient  in  terms  of  storage 
requirements.  We  will  now  consider  the  storage  requirement 
of  decision  trees  and  assume  that  for  each  rule  a  set  of 
single  actions  is  specified.  Given  the  storage  costs  s[i] 
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of  condition  C[ i ]  and  the  storage  requirements  h[  j ]  of  each 
single  action  a[ j ],  we  can  calculate  the  storage  cost  of  a 
decision  tree  not  including  the  storage  space  needed  for  the 
branches.  The  probabilities  of  the  rule  occurrences  are  not 
of  interest  in  case  of  storage  minimization. 


In  general,  a  number  of  actions  are  to  be  performed 
after  having  isolated  a  rule.  If  storage  space  is  to  be 
minimized,  actions  which  have  to  be  performed  independently 
of  the  outcome  of  a  condition  test,  should  be  performed 
before  the  condition  is  tested  (otherwise  the  action  must 
appear  on  each  branch  from  the  condition  test) .  This  is 
called  action  hoisting.  Of  course  hoisting  has  to  be  done 
in  accordance  with  the  requirements  for  the  sequence  in 
which  the  actions  of  the  rules  are  to  be  performed.  Fig. 
1.13  shows  an  example  of  action  hoisting. 


— - - — - — - — — — i 
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Fig.  1.13  (a) 
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[  Sprague66  ]  suggested  to  save  storage  space  by  combining 
branches  which  lead  to  identical  subtrees.  The  structures 
obtained  are  networks  rather  than  trees.  So  we  can  simplify 
the  decision  tree  in  Fig.  1.13(b)  to  the  network  in  Fig. 
1 . 14. 
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Fig.  1.14  Example  of  a  decision  network 


The  last  point  we  want  to  discuss  in  this  section  is  how 
we  actually  convert  a  decision  table  to  a  decision  tree. 
When  creating  trees,  we  start  at  the  root  and  choose  a 
condition  to  test  first.  The  decision  of  which  condition  to 
test  first,  depends  on  the  objective  and  the  conversion 
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algorithm  used.  We  will  discuss  this  question  in  detail  in 
Section  2.1.  After  having  decided  which  condition  to  test 
first,  we  will  have  to  construct  a  subtree  of  n-1  conditions 
for  each  of  the  branches  of  the  first  condition.  To  each 
subtree  corresponds  an  (n-1) -condition  subtable  which  can  be 
obtained  in  the  following  way.  We  can  rearrange  the 
decision  table  such  that  the  row  with  the  chosen  condition 
is  on  top.  Assuming  we  have  limited  entries,  we  shift  the 
rules  with  an  N  outcome  for  the  chosen  condition  to  the 
left,  rules  with  a  Y  to  the  right.  Combined  rules  with  a 
dash  for  this  condition  will  be  split  up  in  two  rules  having 
an  N  and  a  Y,  respectively,  for  this  condition. 

This  process  of  condition  selection  and  splitting  of  the 
subtables  is  continued  until  each  rule  of  the  original 
decision  table  or  an  ELSE  rule  appears  as  one  of  the 
branches  of  a  condition.  An  example,  where  the  ELSE  rule  is 
to  be  tested,  is  shown  in  Fig.  1.15. 
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Fig.  1.15  Example  of  conversion  by  division 

in  subtables 
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1 • 6  Closer  look  at  Binary  Decision  Trees 

The  conversion  of  decision  tables  to  decision  trees  can 
be  interpreted  as  the  partitioning  of  an  n-cube.  The 
vertices  of  the  n-cube  are  the  elementary  rules.  To  each 
vertex  an  action  number  is  assigned.  In  [Iasui72]  three 
kinds  of  partitions  are  distinguished: 

{ 1 }  general  partitions; 

(2)  rule  partitions :  each  block  of  the  partition  is  an  r- 
cube  with  0<r<n.  These  partitions  are  so  called  because 
each  r-cube  can  be  interpreted  as  a  combined  rule  with  r 
dashes . 

(3)  realizable  Partitions  are  rule  partitions  which  can  be 
represented  as  a  decision  tree.  Each  decision  tree 
represents  a  realizable  partition.  Consider,  however, 
the  rule  partition  {0,2},  {1,5},  |3}  ,  {4},  {6,7}  of  the  3- 
cube.  Taking  any  of  the  three  conditions  as  the  root  of 
the  decision  tree  splits  up  one  of  the  1-cubes  {  C[ 1  ] 
splits  up  {1,5},  C[  2  ]  splits  up  {0,2},  and  C[  3  ]  splits 
up  {6,7}).  Thus  this  partition  is  not  realizable. 

We  want  to  add  a  fourth  definition: 

(4)  complete  partition:  each  block  consists  of  a  0-cube. 
This  partition  is  certainly  realizable  and  corresponds 
to  the  complete  decision  tree. 

The  decision  problem,  independent  of  the  actual  decision 
table  representation,  can  be  considered  as  a  general 
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partition  on  the  n-cube.  The  blocks  of  the  partition  are 
built  fro®  adjacent  vertices  with  the  same  action.  Some  of 
the  blocks  might  correspond  to  the  ELSE  rule.  We  will 
assume  for  the  remainder  of  this  section  that  we  do  not  test 
the  ELSE  rule. 

In  order  to  formulate  the  decision  table,  the  partition 
must  be  refined  to  a  rule  partition.  In  general,  this 
process  is  not  unique.  For  example,  if  we  have  a  block  of 
three  adjacent  vertices,  there  are  two  ways  to  split  up  the 
block  into  a  1-cube  and  a  0-cube. 

The  other  extreme  of  the  general  partition,  which 
defines  the  problem  and  has  the  least  number  of  blocks  of 
all  partitions,  is  the  complete  partition.  Instead  of 
splitting  up  blocks,  we  can  combine  0-cubes  of  identical 
actions  to  form  cubes  of  higher  dimensions.  Thus  we  get  a 
sequence  of  realizable  partitions  with  a  decreasing  number 
of  blocks. 

For  n<4  we  can  represent  the  n-cube  as  a  Karnaugh  map. 


Consider  the  following  example 
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Fig.  1.16  Rule  partition  represented 
as  Karnaugh  map 
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Fig.  1.17  Decision  table  corresponding 
to  the  rule  partition  in  Fig.  1.16 


Fig.  1.16  is  an  example  of  one  possible  rule  partition. 
Each  block  of  this  partition  can  be  expressed  as  a  combined 
rule.  The  decision  table  whose  structure  corresponds  to 
this  rule  partition  is  shown  in  Fig.  1.17. 


-28- 


It  is  not  trivial  to  decide  in  general  whether  a  rule 
partition  is  realizable.  We  have  to  devise  an  algorithm 
which  checks  the  realizability  of  a  rule  partition  and 
refines  the  partition  if  necessary.  As  there  are  usually 
many  ways  to  achieve  a  realizable  partition,  we  want  our 
algorithm  to  choose  the  one  with  the  minimum  number  of 
blocks.  This  criterion  is  reasonable  as  the  realizable 
partition  with  the  minimum  number  of  blocks  corresponds  to 
the  decision  tree  with  the  least  number  of  condition  tests. 
Each  block  of  a  rule  partition  is  a  set  of  elementary  rules. 
Splitting  up  a  block  in  two  cubes  of  lower  dimensionality  is 
affected  by  a  condition  test.  Each  step  in  the  refinement 
of  the  partitions  increases  both  the  number  of  blocks  by  one 
and  the  number  of  condition  tests  in  the  decision  tree  by 
one.  Hence,  if  a  realizable  partition  consists  of  m  blocks, 
the  corresponding  decision  tree  contains  m-1  condition 
tests . 

[ Rabin? 1]  gives  a  heuristic  method  for  approaching  the 
minimal  realizable  partition  given  any  rule  partition.  A 
so-called  neutral  number  b[ i ]  of  each  condition  C[ i ]  is 
introduced  which  is  the  number  of  blocks  in  the  rule 
partition  which  are  split  up  when  testing  condition  C[i]. 
So  we  have  in  Fig.  1.16  b[ 1 ]  =  2,  b[ 2 ]  =  3,  b[ 3  ]  =  1,  b[  4 ]  = 
1.  A  necessary  condition  for  a  rule  partition  to  be 
realizable  is  that  at  least  one  of  the  b[i]  is  0.  A  method 
to  decide  whether  a  rule  partition  is  indeed  realizable 
follows.  If  a  b[ i ]  is  0,  condition  C[ i  ]  divides  the  n-cube 
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in  two  fn-1) -cubes.  For  these  cubes  we  recalculate  the 
neutral  numbers.  Again  we  require  that  at  least  one  of  the 
neutral  numbers  of  each  (n- 1) -cube  is  0.  If  we  have  more 
than  one  neutral  number  being  0,  we  have  to  try  all  these 
possible  continuations.  Continuing  this  process  and  using 
some  kind  of  backtracking,,  we  finally  could  decide  whether 
the  rule  partition  is  realizable. 

If  we  encounter  all  non-zero  neutral  numbers  we  have  one 
block  to  split  up.  Rabin  suggests  testing  a  condition  with 
the  lowest  neutral  number.  This  is  only  a  heuristic  method 
for  finding  the  minimal  decision  tree.  However*  an 
exhaustive  search  probably  would  not  be  very  meaningful 
since*  as  we  already  know*  often  the  rule  partition  which  is 
the  starting  point  of  the  algorithm*  is  not  unique  and  there 
might  be  other  rule  partitions  which  lead  to  the  optimum. 
Note*  that  once  a  rule  partition  is  given*  only  refinements 
of  this  partition  are  considered  and  no  other  combinations 
of  rules  are  tested. 

A  similar  approach  is  suggested  in  [Pollack65].  In  this 
paper  heuristics  for  conversion  to  decision  trees  with 
minimum  storage  requirements  and  with  minimum  average 
processing  time  are  proposed.  The  latter  will  be  briefly 
described  in  Section  2.1.  The  former  differs  from  Eabin®s 
algorithm  mainly  in  that  it  does  not  choose  the  condition 
which  splits  up  the  least  number  of  blocks*  but  the 
condition  where  the  number  of  vertices  of  the  blocks  split 
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up  is  minimal.  This  number  of  vertices  is  called  the  dash 
count  dc[ i ].  In  our  example,  we  have  dc[ 1  ]  =  4,  dc[ 2  ]  =  10, 
dc[  3 ]  =  4,  dc[  4 ]  =  4.  The  algorithm  in  [Pollack65]  is 
formulated  for  tables  and  not  for  partitions.  The  column 
count  of  a  rule  is  the  number  of  elementary  rules  composing 
the  rule.  The  dash  count  of  a  condition  is  the  sum  of  the 
column  counts  of  the  rules  which  have  a  dash  for  that 
condition.  Starting  with  the  compressed  decision  table  in 
Fig.  1.17  we  get  the  same  dash  counts  (see  Fig.  1.18). 

i - 1 
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Fig.  1.18  Column  counts  (CC)  and  dash  counts  (DC) 

of  a  decision  table 

The  methods  just  described  start  with  a  rule  partition 
and  refine  this  partition  until  it  is  realizable.  In  this 
thesis  we  will  suggest  a  method  which  starts  with  the 
complete  partition  and,  after  examining  (at  least 

implicitly)  all  possible  realizable  partitions,  finds  the 
minimal  realizable  partition  for  the  given  problem.  We  will 
see  in  Section  2.2  that  dynamic  programming  is  very 
appropriate  for  converting  decision  tables  to  optimal 
decision  trees. 
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In  terms  of  partitions  we  can  describe  dynamic 
programming  such  that  starting  with  the  Q-cubes,  we  build 
optimal  realizable  partitions  for  all  possible  k-cubes  with 
1<k<n.  Combining  two  (k-1) “Cubes  and  knowing  their 
realizable  partitions,  it  is  easy  to  construct  a  realizable 
partition  of  the  k-cube.  A  k-cube  can  be  split  up  in  k 
different  ways  in  (k-1) -cubes,  thus  there  are  k  different 
possible  combinations  of  (k-1) -cubes  to  obtain  the  k-cube. 
We  choose  the  optimal  realizable  partition  of  these  k 
partitions  obtained.  We  do  not  have  to  save  the  information 
on  the  other,  non-optimal  partitions,  as  in  the  remainder  of 
the  process  the  partitions  are  less  fine.  The  optimal 
partition  of  a  cube  cannot  contain  a  non-optimal  partition 

i 

of  a  sub-cube  since  the  non-oprimal  partition  could  be 
replaced  by  the  optimal  one. 

A  k-cube  of  a  realizable  partition  is  represented  in  a 
complete  decision  tree  as  a  subtree  of  length  k,  which 
reaches  to  the  leaves,  i.e.  the  root  of  the  subtree  is  in 
the  k-th  level  from  the  bottom.  We  call  such  a  subtree  of 
length  k  simply  a  k-tree.  The  many  ways  in  which  the  k-cube 
itself  can  be  partitioned  corresponds  to  the  number  of 
arrangements  of  the  conditions  in  the  subtree.  Having  an 
optimal  partition  of  a  k-cube,  we  have  the  optimal  subtree 
structure.  The  dynamic  programming  approach  thus  can  be 
interpreted  as  a  process  where  optimal  subtrees  of 
increasing  length  are  sought  and  combined  until  finally  the 
optimal  n-tree  has  been  found. J 

/ 

/ 
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In  some  of  the  papers  on  decision  tables  the  conversion 
problem  has  been  said  to  be  akin  to  the  traveling  salesman 
problem,  where  a  Hamiltonian  cycle  of  minimal  length  is  to 
be  found.  The  similarity  of  the  problems  is  difficult  to 
see,  and  the  difference  in  the  magnitude  in  the  number  of 
possible  solutions  is  striking.  For  the  traveling  salesman 
problem  the  branch-and-bound  method  is  considered  to  be 
superior  to  the  dynamic  programming  approach  [Bellman62, 
Held62,  Little63  ].  As  we  will  show  in  this  thesis,  for 
decision  table  conversion,  dynamic  programming  is  much  more 
efficient  than  the  branch-and-bound  algorithm  proposed  in 
[ Eeinwald66  ]. 

The  minimal  cover  problem  in  the  Boolean  algebra,  a 
description  of  which  can  be  found  in  any  textbook  on 
switching  theory,  is  similar  to  the  decision  table 
conversion  problem.  However,  there  are  two  differences  which 
complicate  the  solution  of  the  minimal  cover  problem 
considerably  relative  to  the  decision  table  conversion 
problem : 

(1)  Minimal  covers  need  not  be  realizable. 

(2)  Minimal  covers  need  not  be  partitions  (i.e.  the  cubes 

may  overlap) . 

The  minimal  cover  problem  is  equivalent  to  the  problem 
of  formulating  the  decision  table  with  as  few  rules  as 
possible  where  the  table  may  be  redundant. 
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1 . 7  Outline  of  the  Thesis 

Chapter  2  will  be  dedicated  to  conversion  of  decision 
tables  to  decision  trees  of  minimal  execution  time*  Me  will 
review  some  of  the  known  methods  in  Section  2*1®  As  far  as 
we  know*,  the  only  published  algorithm  which  finds  the 
optimal  decision  tree  if  the  probabilities  of  the  elementary 
rules  and  the  testing  times  of  each  of  the  conditions  are 
given  is  a  branch -and -bound  method  proposed  in  [ Reinwaid66  ]. 
This  method  is  described  for  limited-entry  decision  tables, 
but  could  be  generalized  to  extended-entry  decision  tables 
as  has  been  pointed  out  in  that  publication.  As  the  cost  of 
the  branch-and-bound  method  is  prohibitive  for  decision 
tables  with  more  than  five  conditions,,  a  number  of 
heuristics  have  been  developed.  We  will  review  an  early*, 
simple  algorithm  [Pollack65]  and  a  modification  suggested  in 
[ Shwayder71  ].  These  heuristics  assume  equal  costs  for  all 
condition  tests,  whereas  a  more  sophisticated  and  more 
recent  heuristic  uses  the  same  input  specification  as  the 
branch-and-bound  method  [ Ganapathy73 ]• 

After  applying  dynamic  programming  to  expanded,  limited- 
entry  decision  tables,  we  will  generalize  this  method  for 
extended  and  mixed  entries  in  Section  2.3.  A  method  often 
suggested  is  to  transform  extended  entries  to  limited 
entries  in  a  first  step  of  the  conversion  process.  However, 
this  transformation  increases  the  number  of  conditions  and 


generates 


a  number  of  logically  impossible  rules. 


A 
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consequence  of  this  is  that  the  code  thus  generated  can  be 
expected  to  be  longer  than  necessary.  In  [Woods71],  it  is 
estimated  that  a  direct  conversion  would  save  about  10  to  35 
percent  of  the  code. 

In  Section  2.4  we  discuss  the  conversion  of  compressed 
decision  tables  and  comment  on  the  publication  [ Verhelst7  2  ]r 
which  is  devoted  to  this  problem. 

In  Section  2.5  we  briefly  outline  an  efficient  way  to 
implement  Ganapathy*s  algorithm  [ Ganapathy73 ] .  Me  suggest  a 
slight  modification  to  this  algorithm.  Finally  we  compare 
the  order  of  Ganapathy* s  algorithm  and  of  the  dynamic 
programming  algorithm  and  give  figures  for  the  CPU  time 
needed  for  conversion  of  a  decision  table  using  these  two 
methods. 

In  Chapter  3  the  emphasis  will  be  on  the  conversion  to 
decision  trees  requiring  minimal  storage  space.  In  times  of 
virtual  storage  and  cheaper  primary  memories  the 
minimization  of  storage  is  no  longer  considered  as  important 
as  time  minimization.  Besides  that,  if  condition  tests 
require  many  instructions,  they  can  be  written  as 
procedures,  thus  reducing  the  storage  requirements  although 
increasing  execution  time  slightly. 

Throughout  Chapter  3  we  will  consider  only  decision 
trees,  not  networks  where  different  branches  might  lead  to 
the  same  subtree.  Creation  of  optimal  networks  is  much  more 
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time  consuming  when  constructing  the  network  top-down , 
it  is  difficult  to  see  now  it  could  be  done  with  dynamic 
programming.  As  is  pointed  out  in  [Myers72]?  action 
hoisting  and  combining  identical  subtrees  often  affect  each 
other  adversely.  Myers  describes  some  storage  optimization 
techniques  and  suggests  that  action  hoisting  should  be  done 
during  the  actual  tree  generation  whereas  the  removal  of 
redundant  code  should  follow  as  a  separate  step. 

In  Section  3.1  we  use  dynamic  programming  to  solve  the 
problem  of  converting  to  trees  requiring  minimum  storage. 
In  Section  3.2  we  include  action  hoisting  in  the 
optimization  process. 

PL/1  procedures  for  time-minimal  and  storage-minimal 
conversion  of  mixed  entry  decision  tables  are  listed  in 
Appendices  A  and  B,  respectively. 
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2 •  Conversion  to  Decision  Trees  of  Minimum  Average 

Execution  Time 


2 . 1  Known _ Met hods 

2.1.1  A  Branch-and-Bound  Algorithm 

The  branch-and-bound  algorithm  proposed  by  Reinwald  and 
Soland  [ Reinwald66 ]  finds  the  decision  tree  of  minimum 
average  execution  time  provided  the  costs  of  the  condition 
tests  and  the  probabilities  of  all  elementary  rules  are 
given.  The  ELSE  rule  may  be  tested  or  not. 

The  rationale  of  the  branch-and-bound  method  in  general 
is  the  partitioning  of  the  set  of  all  possible  solutions 
where  a  lower  bound  of  the  cost  of  the  solutions  in  each 
block  is  known.  If  a  solution  is  characterized  by  a  number 
of  variables ,  a  block  of  a  partition  contains  all  solutions 
where  some  of  the  variables  have  fixed  values.  Assigning 
fixed  values  to  one  of  the  free  variables  means  splitting  up 
the  block  in  smaller  blocks  thus  obtaining  a  finer 
partition.  Although  any  of  the  blocks  with  unspecified 
variables  could  be  chosen,  usually  the  block  with  the 
smallest  bound  is  refined. 
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For  the  branch-and-bound  method  it  is  essential  that  a 
lower  bound  of  the  cost  of  solutions  in  a  block  can  be 
calculated  fairly  easily*  particularly  without  enumerating 
all  solutions  in  the  block.  However*  it  is  also  important 
to  find  a  lower  bound  that  is  not  too  far  from  the  real 
minimum.  The  better  the  bounds*  the  faster  the  algorithm 
terminates.  A  minimum  is  found  if  there  is  a  block 
containing  only  one  solution  and  having  a  cost  that  is  not 
higher  than  the  lower  bound  of  any  other  block.  If  we  want 
to  find  the  set  of  all  minimum  solutions*  we  have  to  proceed 
until  all  blocks  consisting  of  mere  than  one  solution  have 
higher  bounds  than  the  minimum  cost.  The  bound  of  blocks 
consisting  only  of  one  solution  should  be  the  real  cost  of 
this  solution. 

In  the  description  of  Beinwald®s  and  Soland*s  algorithm 
we  will  confine  ourselves  to  limited-entry  decision  tables 
as  is  also  done  in  [ Reinwald66 ] .  Before  we  discuss  how  to 
find  a  lower  bound  of  the  set  of  all  decision  trees  and  how 
to  calculate  the  bounds  of  the  generated  blocks  when 
refining  a  partition*  we  will  describe  the  partitioning 
process.  We  will  consider  partitions  of  blocks  representing 
all  decision  trees  where  the  upper  k  levels  (for  any  k)  of 
condition  tests  are  fixed.  We  call  such  a  block  simply  a 
k-block.  A  partition  may  be  composed  of  k-blocks  of 
different  k. 
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In  a  first  step  the  set  of  all  decision  trees  is 
partitioned  in  n  1-blocks.  Then  one  of  these  1-blocks  is 
selected  and  refined  in  a  number  of  2-blocks.  The  first 
condition  test  of  the  decision  trees  represented  by  these  2- 
blocks  is  fixed.  At  the  NO-  and  YES-branch  of  this 
condition  test  there  may  be  one  out  of  n- 1  conditions  to  be 
tested  next.  Thus,  the  1-block  is  to  be  refined  in  (n-1}**2 
2-blocks.  In  general,  selecting  a  k-block  for  refinement, 
the  number  of  branches  to  be  continued  with  one  of  the 
remaining  n-k  condition  tests  is  2**k.  Thus,  a  k-block  is 
to  be  refined  in  (n-k) ** (2**k)  (k  +  1) -blocks . 

This  partitioning  process  can  be  represented  in  form  of 
a  tree  (see  e.g.  Fig.  2.3).  A  k-block  corresponds  to  a  node 
in  level  k  of  the  tree,  starting  with  level  0  at  the  root 
which  represents  the  total  set  of  decision  trees.  Selecting 
a  k-block  for  refinement  means  expanding  this  node  to  (n- 
k) (2^*k)  nodes  representing  the  (k+1) -blocks  of  this  k- 
block.  At  each  stage  of  the  partitioning  process,  the 
blocks  of  the  current  partition  correspond  to  the  leaves  of 
the  tree.  Note  that  selecting  a  k-block  for  refinement 
implies  that  all  of  its  (k+1) -blocks  have  to  be  added  to  the 
tree  and  a  bound  has  to  be  calculated  for  all  these  (k+1)- 
blocks. 

When  applying  a  branch-and- bound  method,  the  main 
difficulty  is  how  to  find  a  lower  bound  of  a  block.  In 
Section  1.6  we  saw  that  a  decision  tree  can  be  interpreted 
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as  a  realizable  partition®  Further  we  know  that  refining  a 
rule  partition  to  a  realizable  partition  can  never  decrease 
the  lower  bound  on  the  cost  of  the  partition.  A  lower  bound 
of  the  realizable  partitions  cannot  be  efficiently 
determined.  However*  a  lower  bound  of  .the  rule  partitions* 
which  obviously  is  also  a  lower  bound  of  the  realizable 
partitions*  can  be  given  in  the  following  way. 

We  know  that  the  cost  of  the  complete  partition  equals 
the  sum  of  the  costs  of  all  condition  tests.  Combining  two 
appropriate  0-cubes  to  a  1-cube  yields  a  gain  provided  the 
1-cube  is  contained  in  a  realizable  partition.  The 
potential  gain  of  a  2-cube  equals  the  sum  of  the  potential 
gains  of  the  four  1-cubes  which  can  be  built  from  the  four 
0-cubes  of  the  2-cube.  Note  that  the  probability  of  each  of 
the  two  condition  tests  involved  is  equal.  In  general*  the 
potential  gain  of  a  cube  of  any  dimension  equals  the  sum  of 
the  potential  gains  of  all  1-cubes  contained  in  that  cube® 
In  this  sense  we  can  say  that  the  potential  gain  of  a  rule 
partition  equals  the  sum  of  the  gains  of  all  1-cubes 
contained  in  that  partition.  Thus  the  sum  of  the  gains  of 
all  1 -cubes  that  can  be  built  from  the  complete  partition  is 
an  upper  bound  of  the  potential  gain  of  a  rule  partition. 
Given  the  expanded  decision  table  we  maximize  the  dash 
entries  for  each  row  separately  and  add  the  gains  connected 
with  the  dash  entries.  The  difference  between  the  sum  of 
the  costs  of  all  condition  tests  and  this  maximal  potential 
gain  is  a  lower  bound  for  the  cost  of  the  decision  trees. 
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For  example,  in  Fig.  2.1,  we  maximize  the  chance  of  avoiding 
the  test  of  condition  C[ 1  ]  by  combining  rules  6  and  2.  Then 
with  probability  0.35,  we  can  avoid  a  cost  of  50.  Thus, 
considering  only  condition  C[ 1  ],  we  see  a  potential  savings 
of  17.5.  After  considering  the  other  conditions  in  turn,  we 
conclude  that  the  total  potential  savings  available  is  46.1. 
Therefore,  the  costs  of  the  decision  trees  converted  from 
the  decision  table  in  Fig.  2.1  have  a  lower  bound  of  143 
46.1  =  96.9. 


s - - - 1 

jrule#  7  6  2|5  4  §  3  1  Oj  fpot.J 

jprob.  0.00  0.15  0.20J  0.05  0 . 2  5 1  0.20  0.00  0.  1 5 1 cost | gainj 

I - t 

I  C[  1  ]  |  Y  Y  N  |  Y  Y  j  N  N  N  |  50  |17.5| 

|  C[  2  ]  j  Y  Y  Y  |  N  N  |  Y  N  N  |  68  M3.6J 

|  C[  3  ]  |  Y  N  N  |  Y  N  j  Y  Y  |  2  5  f  1 5 . 0  8 

8 - j - - — - - - - - - - —  S 

|  A[1]  \  A[2]  ?  A[3]  |143  j46.1  S 

i _ _ _ _j 

Fig.  2.1  Decision  table  of  Example  1 
([  Beinwald66  ]) 


The  next  question  we  have  to  answer,  is  how  to  find  a 
lower  bound  of  the  1-blocks.  Testing  a  condition  means  that 
the  1-cubes  along  this  condition  axis  are  split  up  and  their 
gains  cannot  be  realized.  Thus  we  have  to  add  the  maximal 
potential  gain  calculated  for  that  condition  to  the  lower 
bound  of  the  block  of  level  0.  For  example,  the  lower  bound 
of  the  decision  trees  starting  with  C[  2 ]  is  96.9  +  13.6  = 


110.5. 
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As  described  briefly  at  the  end  of  Section  1.5?  after 
having  selected  a  condition  for  testing?  the  table  has  to  be 
divided  in  two  subtables  (see  Fig-  2.2)  corresponding  to  the 
NO-  and  YES-outcome  of  the  decision. 


i - - - - — - - - - — — — * — -  — ~ — * — — — — 

| rule#  15  4  j  1  01  |  pot.  1 

Iprob.  |0.05  0.25  |0.00  0.15  jj  cost  |  gain  | 
I — - — — - —  i 

1  C[  1 ]  i  Y  YIN  N  I  50.0  i  0.0  | 

|  C[3]  |  Y  N  1  Y  N  f  25.0  |  11.251 

a , - - - - — — s~ — — " 

1  A[2]  1  A[3]  | 

a - - — _ - - — - j 

Fig.  2.2(a)  Subtable  derived  from  table 
in  Fig.  2.1  assuming  C[ 2 ]=N0 
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1  C[1]  1  Y  Y  N  1  N  j  50.0  f  17.5  j 

1  C[  3 ]  \  Y  N  N  f  Y  |  25.0  |  3.751 

i - ~ , - - — - — — —  s - - - - — J 

I  A[  1  ]  i  A[  3  1  1 

i _ _ _ _ — - - - - _ - j 

Fig.  2.2(b)  Subtable  derived  from  table 
in  Fig.  2.1  assuming  C[2]=YES 


In  Fig.  2.3  the  branching  tree  of  this  example  is  shown. 
Nodes  5  to  8  represent  the  four  2-blocks  having  C[ 2 ]  as 
first  condition  test.  Note  for  example  how  the  bound  of 
node  7  is  obtained.  In  case  of  C[ 2  ]=NO  condition  C[ 3  ]  is 
tested  thus  losing  the  potential  gain  of  11.25  (see  Fig.  2.2 
(a)).  Similarly  for  C[ 2  ]=YES  a  potential  gain  of  17.5 
cannot  be  realized.  The  increase  of  the  lower  bound 


-42- 


compared  to  node  3  equals  the  sum  of  these  potential  gains 
(110.5  ♦  11.25  +  17.5  =  139.25). 
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Fig.  2.3  Branch  tree  developed 
when  converting  table  in  Fig.  2.1 


I 


I 


I 
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The  numbering  of  the  nodes  in  Fig.  2.3  corresponds  to 
the  sequence  in  which  the  nodes  are  created.  After 
expanding  node  3,  the  partition  consists  of  the  blocks 
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numbered  2* 4 * 5* 6* 7* 8.  Since  node  4  has  the  lowest  bound* 
this  1-block  is  refined  resulting  in  the  partition 
consisting  of  blocks  numbered  2*5*6*7*8*9*10*11*12.  Node  11 
has  lowest  bound.  Since  this  2-block  consists  of  one 
decision  tree  only*  the  optimal  tree  is  found. 

The  conversion  time  and  storage  required  for  this 
algorithm  grows  very  fast  with  n.  As  we  saw*  a  block  of 
level  k  is  split  up  in  (n-k) ** <2**k)  (k+1) -blocks.  For 
example*  for  n=6  conditions  and  for  k=4  expansion  of  a  node 
results  in  another  2 16  nodes  in  the  fifth  level  of  the 
branching  tree.  The  number  of  nodes  in  the  branching  tree 
that  have  to  be  developed*  depends  obviously  on  the  data. 
In  the  worst  case  all  nodes  might  have  to  be  visited.  This 
occurs*  for  example*  in  the  trivial  case  where  all 
elementary  rules®  actions  are  different  and  all  possible 
decision  trees  have  identical  costs.  Thus*  it  is  not 
possible  to  give  a  non-trivial  upper  bound  on  the  number  of 
nodes  to  visit.  This  is  a  drawback  of  this  algorithm  as  it 
is  hard  to  estimate  how  long  it  will  take  the  algorithm  to 
guarantee  the  optimality  of  the  solution.  As  we  mentioned* 
there  are  theoretical  cases  where  the  algorithm  degenerates 
to  an  exhaustive  search. 

Certainly*  these  hypothetical  cases  are  not  typical  in 
practice.  However*  it  is  difficult  to  estimate  a  reasonable 
figure  for  the  percentage  of  the  nodes  that  have  to  be 
evaluated  on  average.  In  tests  with  random  decision  tables 
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of  four  and  five  conditions  the  medians  of  the  number  of 
nodes  visited  have  been  about  20  and  2  percent, 
respectively.  Certainly  the  expected  percentage  of  nodes  to 
visit  decreases  rapidly  for  increasing  number  of  conditions. 
However,  if  we  assume  only  a  factor  of  10“*,  for  n=6  we 
would  still  have  to  evaluate  about  109  nodes  which  would 
take  several  hours.  Larger  problems  with  more  conditions 
could  require  many  years  and  are  entirely  infeasible.  Along 
with  the  vast  storage  requirements,  the  storing  and 
retrieving  of  nodes  is  a  major  problem  with  this  algorithm. 


2.1.2  Pollack's  Heuristic 

In  Section  1.6  we  briefly  discussed  Pollack's  "quick- 
rule  algorithm"  which  tries  to  minimize  the  storage 
requirements  of  the  decision  trees  generated.  In  the  same 
paper  [Pollack65]  a  similar  heuristic,  the  "delayed-rule 
algorithm",  has  been  proposed.  Its  objective  is  the 
minimization  of  the  average  execution  time.  For  this 
conversion  method  the  decision  table  is  assumed  to  be  given 
in  a  compressed  form,  and  the  actions  associated  with  any 
two  rules  are  considered  to  be  different.  This  assumption 
disallows  locating  the  optimal  tree  in  certain  cases  where 
two  combined  rules  actually  lead  to  the  same  action.  The 
probabilities  of  the  combined  rules  are  given  whereas  the 
time  needed  for  each  condition  test  is  assumed  to  be  the 


same.  The  ELSE  rule  is  to  be  tested. 


-45- 


As  for  the  quick-rule  algorithm?  we  need  the  terms 
column  count  and  dash  count.  If  a  rule  has  r  dashes?  the 
column  count  of  the  rule  is  The  dash  count  of  a 
condition  is  the  sum  of  the  column  counts  of  those  rules 
which  have  a  dash  entry  for  this  condition.  In  addition?  we 
introduce  the  weighted  dash  count  which  is  built  analogously 
to  the  dash  count?  but  the  column  counts  are  weighted  by  the 
probability  of  the  rules. 

At  the  end  of  Section  1.5  we  described  how  the  decision 
tree  is  developed  and  the  decision  table  is  split  up  in 
subtables.  We  said  that  the  different  heuristics  available 
differ  in  the  selection  criterion  for  the  condition  to  test 
next.  The  rationale  behind  the  delayed-rule  algorithm  is 
the  same  as  behind  the  quick-rule  algorithm.  Under  the 
condition  of  equal  probabilities  of  the  elementary  rules  and 
equal  costs  of  the  condition  tests  the  decision  tree  with 
minimum  storage  requirements  has  also  minimum  average 
execution  time  as  has  been  pointed  out  for  example  in 
[Rabin71?  Yasui72j.  The  quick-rule  algorithm  chooses  the 
condition  with  minimum  dash  count?  the  delayed-rule 
algorithm  the  condition  with  minimum  weighted  dash  count. 


2.1.3  Shwayderes  Modification 


In  [Shwayder71]  the  replacement  of  the  weighted  dash 
count  selection  rule  by  a  criterion  based  on  information 
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theory  is  suggested.  The  decision  tree  is  considered  as  a 
means  to  sort  out  the  rule  which  is  actually  applicable. 
Each  condition  test  diminishes  more  or  less  the  uncertainty 
of  which  rule  is  applicable.  Dashes  in  the  condition  row  as 
well  as  uneven  probabilities  on  the  outcomes  of  the 
condition  test  diminish  (from  the  ideal  1  bit)  the  amount  of 
uncertainty  removed  by  the  condition  test.  With  the 
notation  used  in  [ Ganapathy73  ],  Shwayder’s  selection  rule  is 
the  following: 

(1)  For  each  row  determine  the  total  probability  of  all 

columns  with  an  N  in  that  row  (pO) ;  the  total 
probability  of  all  columns  with  a  Y  (pi) ;  the 

conditional  probabilities  pN  =  pO/(p(Hp1)  and  pY  = 
p1/(p0+p1) . 

(2)  Compute  the  entropy  I=- (pO+pl) * (pN*log2 (pN)  +pY*log2 (pY) ) 
for  each  row,  which  is  the  conditional  uncertainty 
between  N  and  Y  given  that  it  is  either  N  or  Y.  (3) 
Select  the  row  with  highest  entropy  I. 

It  is  claimed  that  this  modified  algorithm  usually 
generates  decision  trees  with  lower  average  execution  time 
than  the  original  algorithm  by  Pollack.  A  further 
enhancement  of  the  algorithm  has  been  suggested  in 

[ Shwayder74 ]. 
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2.1.4  The  Algorithm  by  Ganapathv  and  Rajaraman 

The  algorithm  proposed  in  [ Ganapathy73  ]  is  an  extension 
and  generalization  of  Shwayder8s  algorithm.  Both  algorithms 
apply  information  theory  when  selecting  a  condition  for 
testing.  Like  the  branch-and-bound  algorithm  by  Reinwald 
and  Solandy  Ganapathy«s  and  Rajaraman® s  algorithm  starts 
with  the  set  of  elementary  rules.  This  removes  the 
restriction  that  different  combined  rales  should  have 
different  actions.  In  Pollack®s  and  Shwayder®s  algorithms  a 
unique  rule  partition  is  given.  In  this  algorithm^  a  rule 
partition  is  associated  with  each  condition.  Elementary 
rules  are  combined  in  such  a  way  that  the  number  of  dash 

entries  is  maximal.  The  entropy  of  a  condition  test  now  is 

calculated  for  the  rule  partition  associated  with  this 
condition.  Different  testing  times  of  the  conditions  are 
taken  into  account.  The  condition  with  the  maximal  quotient 

of  entropy  and  condition  cost  is  chosen  for  testing. 

In  the  following  this  algorithm  is  '  applied  to  the 
decision  table  in  Fig.  2.  1. 

(a)  Data  for  C[  1  ] : 
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With  the  notation  introduced  in  2.1.3  we  get: 

pO  =  0.35;  pN  =  0.35/0.65  =  0.54; 

pi  =  0.30;  pY  =  0.30/0.65  =  0.46; 

Entropy  I[ 1 ]  =  0.65*0.995  =  0.645; 

I[1]/t[1]  =  0.645/50  =  0.0129; 


(b)  Data  for  C[  2  ]  : 
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pO  =  0.45;  pN  =  0.45/0.80  =  0.56; 
pi  =  0.35;  pY  =  0.35/0.80  =  0.44; 
I[ 2  ]  =  0.8*0.987  =  0.79; 

I[ 2  ]/t[ 2 ]  =  0.79/68  =  0.0116; 


(c)  Data  for  C[  3  ]  : 
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pO  =  0.20;  pN  =  0.20/0.  40  =  0.50; 

pi  =  0.20;  pY  =  0.20/0.40  =  0.50; 

I[ 3 ]  =  0. 4*1.0  =  0.4; 

I[ 3  ]/t[ 3  ]  =  0.4/25  =  0.016; 

The  quotient  I[i]/t[i]  is  maximal  for  i=3,  thus  condition 
C[3]  is  selected  for  testing. 


Note  that  this  algorithm  is  also  applicable  if  the  ELSE 
rule  is  not  to  be  tested.  The  only  difference  is  in  the 


determination  of  the  dash  entries.  As  logically  impossible 
rules  may  be  combined  with  any  rule,  we  get  more  dash 
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entries  if  we  do  not  test  the  ELSE  rule.  Thus*  when 
implementing  the  algorithm  in  this  way*  the  time  required 
for  executing  the  algorithm  is  somewhat  higher  when  the  ELSE 
rule  is  not  tested.  In  Section  2.5  we  shall  briefly  discuss 
an  efficient  implementation  of  this  algorithm. 


2 . 2  Conversion  of  Expanded  Limited-Entry  Decision  Tables 


In  this  chapter  we  will  apply  dynamic  programming  to  the 
conversion  of  limited-entry  decision  tables  to  decision 
trees  of  minimum  average  execution  time.  From  the  viewpoint 
of  partitions  we  can  formulate  the  idea  in  the  following 
way.  Our  goal  is  to  achieve  the  realizable  partition  of  the 
n-cube  which  has  minimal  cost.  As  for  the  n-cube*  we  can 
search  for  an  optimal  partition  of  any  k-cube  (0<k<n) .  The 
dynamic  programming  method  searches  for  optimal  partitions 
of  all  k-cubes  for  increasing  k  until  finally  the  optimal 
partition  of  the  n-cube  is  found.  At  the  beginning  the  0- 
cubes  are  given.  The  partitioning  of  the  1-cubes  is 
unambiguous.  The  2-cubes  may  be  composed  of  two  different 
pairs  of  1-cubes.  In  general*  a  k-cube  may  be  split  up  into 
2  (k-1) -cubes  in  k  ways.  Assuming  we  have  the  optimal 
partitions  of  all  (k-1) -cubes  for  some  k ,  we  want  to 
demonstrate  that  we  can  recursively  determine  the  optimal 
partition  of  the  k-cubes. 
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First,  we  want  to  show  that  in  combining  two  (k-1)  -cubes 
into  a  k-cube,  we  get  a  partition  of  the  k-cube  which  is  a 
combination  of  the  partitions  of  the  (k-1) -cubes.  The  cost 
of  this  partition  can  be  calculated  recursively  as  the  sum 
of  the  costs  of  the  partitions  of  the  (k-1) -cubes  and  a 
factor  which  depends  only  on  the  cost  of  the  combining 
condition  and  on  the  k-cube.  We  will  postpone  the  further 
discussion  of  this  until  we  effectively  show  how  to 
calculate  the  cost  of  a  partition. 

Second,  we  want  to  show  that  among  these  k  partitions  of 
the  k-cube  obtained  by  combining  two  (k-1 ) -cubes,  the 
partition  with  the  lowest  cost  is  the  optimal  partition  of 
the  k-cube.  To  prove  this,  assume  there  is  a  partition  with 
lower  cost.  The  process  of  splitting  up  the  k-cube  in  the 
blocks  of  this  partition  must  begin  with  a  split  into  two 
(k-1) -cubes.  The  partition  of  one  of  these  (k-1) -cubes  must 
be  different  from  the  partitions  we  started  with,  as 
otherwise  the  k-cube  would  be  one  of  the  k  partitions  we 
considered  from  which  the  one  with  minimum  cost  has  been 
selected.  The  cost  of  this  (k- 1) -partition  cannot  be  lower 
than  the  cost  of  the  partition  we  assumed  to  be  optimal. 
However,  the  other  factors  of  the  cost  of  the  partition  of 
the  k-cube  (the  k-cube,  the  combining  condition  and  the 
other  (k-1) -cube)  remain  unchanged  thus  the  assumed 


partition  of  lower  cost  does  not  exist 
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As  there  is  a  unique  reversible  relation  between  the 
partition  of  a  k-cube  and  the  structure  of  a  k-tree,  we  can 
interpret  the  process  also  in  the  following  way.  The 
starting  point  is  the  set  of  elementary  rules  which  will  be 
represented  as  the  leaves  of  the  decision  tree.  In  a  first 
step  the  1-trees  (combining  two  leaves)  of  all  possible 
decision  trees  are  built. 

A  subtree  is  not  only  defined  by  the  conditions  in  it 
and  the  ordering  of  the  condition  tests,  but  also  by  the 
^position5’  in  the  tree  (i.e.  the  outcome  of  the  conditions 
not  in  the  subtree  determine  the  set  of  rule  numbers  which 
is  comprised  by  the  subtree)  .  A  25is*k-tuple  of  rule  numbers 

defines  the  position  of  a  k-tree  in  the  n-tree  as  well  as 
the  structure  of  the  subtree. 

In  a  second  step  all  2-trees  in  all  possible  positions 
have  to  be  enumerated.  A  2-tree  may  have  two  different 
structures : 

f - c[  i  1  ] - , 

I  1 

. - C[i2] - 1  , - e[  i  2  ] - , 

i  I  \  1 

or 

- C[i2] - , 

I  I 

r - C[  i  1  1 - g  , - C[  i  1  ] - , 

I  s  §  s 

We  say  we  combine  two  1-trees.  The  set  of  rule  numbers 
comprised  by  both  subtrees  is  assigned  the  lower  of  the 
costs  and  the  corresponding  structure.  We  can  say  that  any 
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optimal  tree  which  has  a  2-cube  comprising  this  set  of  rule 
numbers,  must  contain  the  subtree  found  to  be  optimal. 
Otherwise  we  could  replace  this  subtree  by  the  optimal  one 
with  a  local  gain  and  no  effect  on  the  rest  of  the  tree. 
The  subtree  represents  a  subset  of  the  rule  numbers,  and 
rearranging  the  subtree  is  only  some  permutation  on  this 
subset . 

In  general,  assume  we  have  enumerated  all  optimal  k- 
trees.  Consider  a  particular  (k  +  1)-tree.  We  can  obtain 
this  tree  by  combining  two  appropriate  k-trees.  The  set  of 
conditions  tested  in  the  two  k-trees  must  be  identical  and 
must  be  the  complement  of  the  conditions  to  be  tested  in  the 
first  n-k  levels  of  the  n-tree.  The  sets  of  rule  numbers 
comprised  by  the  two  subtrees  to  be  combined  must  be  related 
as  follows:  ordering  the  rule  numbers  of  both  sets  in  a 
natural  way,  the  differences  between  corresponding  elements 
of  the  sets  must  all  be  the  same.  The  difference  indeed 
must  be  a  power  of  2  (including  2°)  .  The  difference 
determines  the  condition  which  combines  the  subtrees.  The 
subtree  with  the  lower  (higher)  rule  numbers  will  be  at  the 
NO  (YES)  branch.  The  combination  of  two  subtrees 
corresponds  to  the  union  of  the  sets  of  rule  numbers.  This 
unordered  set  of  rule  numbers  is  independent  of  the 
structure  of  the  subtree.  At  the  root  of  the  (k+1)-tree 
there  may  be  any  of  k+1  conditions.  As  we  have  enumerated 
all  optimal  k-trees,  we  have  the  choice  between  k+1  pairs  of 


-53“ 


subtrees  and  can  select  the  combination  with  minimum  cost. 
In  this  way  we  get  all  optimal  (k  +  1) -trees. 

We  have  to  solve  two  problems: 

(1)  we  have  to  find  an  efficient  way  of  enumerating  all 
possible  k-cubes*  and 

(2)  we  have  to  assign  costs  to  the  subtree. 

The  way  of  doing  the  latter  is  obvious*  but  the  means  of 
doing  the  former  is  also  surprisingly  simple. 

Enumeration  of  subcubes 


In  this  section  we  develop  a  method  for  enumerating  all 
k- cubes  (0<k<n)  of  an  n-cube.  A  rule  number  was  defined  as 
a  binary  number  represented  by  the  condition  test  outcomes 
C[1]...C[n].  In  a  k-cube  n-k  of  the  condition  values  are 
fixed*  k  conditions  are  still  unspecified.  Thus*  a 
convenient  way  for  denoting  a  subcube  is  the  representation 
as  an  n-tuple  with  k  dashes  which  denote  the  conditions  not 
yet  tested.  For  example  (-*1*0*-)  comprises  the  rule 
numbers  (4*5*12*13)  and  represents  the  subtrees  containing 
tests  of  conditions  C[ 1  ]  and  C[  4 ]  which  are  reached  over  the 
YES-branch  of  C[2]  and  the  NO “branch  of  C[ 3  ].  The  first 
task  we  have  to  perform  is  to  enumerate  all  k-cubes  using 
this  notation.  The  second  problem  will  be  to  determine  the  k 
ways  in  which  a  k-cube  may  be  synthesized  from  two  (k-1)- 


cubes . 
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We  can  order  the  k-cubes  in  the  form  of  a  matrix  which 
we  will  call  a  k- table  where  we  put  all  k-cubes  represented 
with  the  same  set  of  k  dashes  in  a  row.  There  are  2**(n-k) 
columns  in  the  matrix,  and  the  elements  in  a  row  can  be 
ordered  by  the  binary  number  they  represent  disregarding  the 
dashes.  The  number  of  rows  of  the  matrix  is  n  choose  k,  as 
any  k  out  of  n  conditions  may  be  in  a  k-cube.  The  following 
tables  are  examples  with  n=4,  k=1,  and  k=2. 

Conditions 

in  1-cube  |  0  1  234567 


C[  1  ]  |  -000  -001  -010  -011  -100  -101  -1  10  -111 
C[ 2  ]  §  0-00  0-01  0-10  0-11  1-00  1-01  1-10  1-11 
C[ 3  ]  I  00-0  00-1  01-0  01-1  10-0  10-1  1  1-0  11-1 
C[ 4  ]  |  000-  001-  010-  011-  100-  101-  110-  11  1- 


Pig.  2.4  (a)  1-table 


Conditions 

in  2-cube  j  0  1  2  3 


C[ 1  ]C[ 2 ]  |  --00  --01  --10  --11 

C( 1  ]C[ 3  ]  I  -0-0  -0-1  -1-0  -1-1 

C[1]C[4  ]  j  -00-  -01-  -10-  -11- 

C[  2  ]C[  3  ]  I  0--0  0  —  1  1--0  1--1 

C[2]C[4]  1  0-0-  0-1-  1-0-  1-1- 
C[  3  ]C[  4  ]  I  00--  01--  10--  11- 


Fig.  2.4(b)  2-table 

Consider  now  a  particular  k-cube.  This  k-cube  can  be 
split  up  in  k  pairs  of  (k- 1) -cubes  along  any  of  k  condition 
axes.  It  is  now  essential  to  retrieve  these  (k- 1 ) -cubes 
efficiently  from  the  (k-1) -table.  The  row  in  which  the 
cubes  are  stored  is  defined  by  the  position  of  the  remaining 
k-1  dashes.  The  difference  of  the  column  numbers  of  the 
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matrix  elements  is  determined  by  the  position  of  the  dash 
which  is  split  up.  For  example,  if  the  second  dash  of  -01- 
10-  is  split  up,  the  difference  of  the  column  numbers  in  the 
2-table  is  4.  It  is  most  efficient  to  consider  one  specific 
combination  for  all  k-cubes  in  a  row  rather  than  comparing 
all  possible  combinations  for  one  k-cube  after  the  other. 
Note,  that  there  are  twice  as  many  entries  in  a  row  of  the 


(k-1) -table 

as  in  a  row 

of  the 

k-table . 

Starting 

with 

the 

leftmost 

(k-1)  -cube 

and 

combining 

elements 

with 

the 

appropriate 

column  difference. 

we  get 

the  k-cubes 

in 

the 

left- to- right  order. 

As  an  example  consider  the  k-cubes  with  conditions  C[ 2 ] 
and  C[3]  in  Fig.  2.4  (b) .  Let  us  first  split  up  the  dash  of 
C[2].  Then  we  combine  the  1-cubes  in  the  third  row  of  the 
table  in  Fig.  2.4  (a)  .  The  column  difference  has  to  be  2  as 
there  is  one  non-dash  entry  to  the  right  of  the  dash  split 
up.  The  column  difference  is  2**r  where  r  is  the  number  of 
non-dashes  to  the  right  of  the  dash  to  be  split  up.  Thus  we 
combine  the  1 -cubes  of  that  row  in  the  order 
(0 ,2)  ,  (1 , 3)  ,  (4,6)  ,  (5,  7)  .  For  example  00-0  and  01-0  are 
combined  to  0 — 0,  00-1  and  01-1  to  0--1,  and  so  on. 
Splitting  up  the  dash  of  C[3],  we  combine  1-cubes  of  the 
second  row.  The  column  difference  again  is  2. 
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Assiqning  costs  to  the  subcubes 

Before  we  assign  a  cost  to  a  subcube  we  will  explain 


what  we  shall  mean 

by 

an  action  or 

action 

number 

of  a 

subcube  and  by 

the  probability 

of  a 

subcube . 

The 

probability  of  a 

subcube  simply  is 

the 

sum  of 

the 

probabilities  of 

the 

0-cubes  contained 

in  the 

subcube. 

The 

actions  assigned 

to 

0-cubes  have 

been 

denoted 

as 

A[  1  ], . . .  , A[  m ]  (for  some  integer  m)  or  simply  as  the  numbers 
If  an  elementary  rule  is  logically  impossible?  an 
A[ - 1  ]  is  assigned  to  this  0-cube.  If  the  actions  of  all  0- 
cubes  in  the  k-cube  are  A[-1]  we  assign  A[-1]  to  the 
subcube.  If  all  actions  of  the  0-cubes  except  the  A[-1] 
actions  are  identical  (say  equal  to  A[  j  ])  we  assign  A[  j  ]  to 
the  subcube.  Otherwise  we  assign  A[ 0 ]  which  indicates  that 
the  logically  possible  rules  of  the  k-cube  have  different 
actions.  Obviously?  the  action  of  a  (k+1)-cube  may  be 
determined  recursively  from  the  actions  of  the  k-cubes 
contained  in  the  (k+1)-cube  according  to  the  following 
table. 


I 

A[-1] 

A[0] 

A[  j  ]  i,j>0 

S 

A[-1  ]j 

A[  - 1  ] 

A[0] 

A[  j] 

A[0]  S 

1 

A[i]  1 

1 

A[0] 

A[0] 

A[  o  ] 

A[i] 

A[0] 

A[i]  if  i= j 

A[ 0  ]  if  i*j 

Fig.  2.5  Table  defining  action 
of  combined  subcube 
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Trivially*  the  probability  of  the  (k*1) -cube  is  the  sum 
of  the  probabilities  of  the  k-cubes.  Next  we  will  show  how 
to  calculate  the  cost  of  the  (k*  1 )  -  cube  recursively. 

Assume*  the  optimal  costs  and  the  corresponding 
partitions  of  the  k-cubes  are  given.  Two  k-cubes  are  to  be 
combined  by  a  condition  C[i].  Whether  C[i]  actually  has  to 
be  tested  or  not  depends  on  the  actions  of  the  k-cubes.  If* 
for  example,  both  k-cubes  have  the  same  action  A[j],  j>0* 
C[i]  need  not  be  tested  and  C[i]  will  be  omitted  in  this 
path  of  the  decision  tree.  The  following  table  indicates 
whether  the  condition  combining  two  subcubes  has  to  be 
tested  (=1)  or  not  (=0). 


I  A[-1]  A[0]  A[j]  i,  j>0 


AC -1 1!  0 

l 

A[  0  ]  |  0 

I 

A[ij  S  0 
I 


0  0 

1  1 

1  0  if  i=j 

1  if  i#j 


Fig.  2.6  Table  indicating  whether  combining 
condition  has  to  be  tested 


As  we  mentioned  earlier,  the  cost  of  a  subtree  can  be 
interpreted  as  a  weighted  external  path  length.  Therefore 
the  cost  of  a  (k+ 1 ) -tree  is  simply  the  sum  of  the  cost  of 
the  k-trees  and  an  additional  factor  dependent  on  the  cost 
of  the  testing  condition  C[ i ]  at  the  root  of  the  (k+1) -tree. 
If  the  C[i]  need  not  be  tested  there  will  be  no  additional 
cost  factor.  If  C[ i ]  has  to  be  tested  the  cost  increase  is 
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the  product  of  the  probability  of  the  (k-H)-cube  and  the 
cost  of  the  condition  test.  At  the  beginning  the  0-cubes 
are  assigned  cost  0,  and  the  cost  of  the  k-cubes,  k>0,  can 
be  calculated  recursively. 


We  still  have  to  justify  the  way  we  assign  the  action 
numbers  to  the  subcubes.  Consider  the  following  example. 


rule#  0123 
action#  1212 

(a)  test  C[  1  }  first: 


S 

S 

i - C[  2  ] - 5 

I  >A[  0  ]<  | 

i  § 

A[  1  ]  A[  2  ] 


-C[  1  ]- 
>A[ 0  ]< 


A[1] 


« 

•C[2> 


>A[  0  ]<  | 

l 

A[  2] 


Note  that,  with  our  method,  C[ 1  ]  would  be  indicated  as 
necessary  to  test  although  the  branches  of  C[ 1  ]  lead  to 
identical  subtrees  and  thus  C[ 1 ]  need  not  be  tested.  The 
optimal  tree  is 

r - C[  2  ] - n 

1  s 

A[  1  ]  A[  2  ] 


However,  this  optimal  tree  will  also  be  found  with  our 


method  when  checking  case  (b) . 
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(b)  test  C[  2  ]  first: 

r - - - C[  2  ]  — - — - — - — i 

S  >A[  0  ]<  1 

i  f 

i — - C[  1  ]— ■  i — — — C[  1  1 - n 

S  >A[  1  ]<  f  I  >A[  2  ]<  \ 

i  I  \  i 

A[  1  ]  A[  1  ]  A[  2  ]  A[  2  ] 

The  action  attached  to  a  node  C[ i ]  is  the  action  of  the 
subtree  the  root  of  which  is  C[i].  A  condition  is  not 
tested  if  the  action  of  this  node. is  A[i],  i#0,  or  if  one  of 
the  branches  of  the  condition  leads  to  a  node  labeled  with 
A[ - 1  ] .  Because  an  action  A[i],  i#0,  implies  that  all 
conditions  below  this  node  have  the  same  action  A[ i  ] 
attached,  the  complete  subtree  can  be  replaced  by  a  leaf 
labeled  A[ i ]. 

The  latest  example  suggests  that  it  is  indeed  sufficient 
to  indicate  only  whether  all  logically  possible  rules  of  a 
subtree  have  the  same  action  and  that  it  is  not  necessary  to 
compare  the  patterns  of  actions  of  the  subtrees. 

The  information  we  have  to  store  with  each  k-cube,  is 

(1)  the  probability  of  the  subcube, 

(2)  the  action  number  of  the  subcube, 

(3)  the  cost  of  the  optimal  partition  of  the  subcube,  and 

(4)  the  optimal  partition  itself. 

The  optimal  partition  can  be  stored  simply  as  pointers 
to  the  two  optimal  (k-1) -cubes  the  k-cube  is  composed  of. 


-60- 


As  we  briefly  mentioned  in  Chapter  1 ,  in  case  of 
minimization  of  the  average  execution  time,  we  can  calculate 
the  cost  of  a  decision  tree  as  the  difference  of  the  sum  of 
the  condition  costs  minus  the  gains  obtained  by  the 
conditions  which  are  not  tested.  The  gain  of  not  testing  a 
condition  C[  i ]  at  the  root  of  a  subtree  is  simply  the 
product  of  the  condition  cost  and  the  probability  of  the 
subtree.  It  can  easily  be  seen  that  the  sum  of  the  cost  of 
a  subtree  and  the  gain  of  the  subtree  is  exactly  the  product 
of  the  probability  of  the  subtree  and  the  sum  of  the  costs 
of  the  conditions  tested  within  the  subtree.  Thus  an 
alternate  method  which  results  in  the  identical  subcubes 
with  fewer  computations  is  the  following  modification: 

Instead  of  minimizing  the  cost  of  a  subtree,  maximize 
the  gain  of  the  subtree.  The  gain  of  a  subtree  is  the  sum 
of  the  gains  of  the  combined  trees  and  an  additional  gain  in 
case  where  the  combining  condition  need  not  be  tested. 

Example  1 

We  will  apply  the  developed  method  to  the  following 
decision  table  which  is  the  example  used  in  Section  2.1  for 
the  branch-and-bound  method.  (Since  this  is  the  example 
used  in  [ Beinwald66 ],  we  do  not  want  to  change  the  actions 
of  the  rules  with  probability  zero.  If  they  are  to  be 
considered  as  ELSE  rules,  an  action  A[ 4  ]  should  be  assigned 
to  them.) 
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r 

| rule  # : 

1 prob . : 

7 

0.00 

6 

0.15 

2  i 
0. 20  | 

5  4 

0.05  0. 

i 

25  | 

3 

0.20 

1 

0.00 

0  1 

0.151  cost : 

I 

i  cc  131 

y 

Y 

N  1 

Y 

Y 

1 

N 

N 

N  1  50.0 

|C[2]i 

Y 

Y 

Y  1 

N 

N 

3 

Y 

N 

N  1  68.0 

iC[3]{ 

a 

Y 

N 

N  | 

Y 

N 

1 

Y 

Y 

N  1  25.0 

« 

1 

0 _ 

At  1  ] 

1 

A[2] 

I 

A[  3  ] 

8 

1 

i 

j 


(a)  Testing  the  ELSE  rule: 


step  0 


0-cubes 

|  prob. 

1  action 

gain 

000 

1  0. 

15 

1 

3 

0. 

0 

001 

I  0. 

00 

1 

3 

0. 

0 

010 

f  0. 

20 

1 

1 

0. 

0 

011 

1  0. 

20 

f 

3 

0. 

0 

100 

1  0. 

25 

I 

2 

0. 

0 

101 

\  0. 

05 

1 

2 

0. 

0 

110 

1  o. 

15 

i 

1 

0. 

0 

11 1 

s  0. 

00 

1 

1 

0. 

0 

step_2 

1-cubes 

1  prob . 

1  action 

gain 

-00 

1  0. 

40 

1 

0 

0. 

0 

-01 

1  o. 

05 

1 

0 

0. 

0 

-10 

1  0. 

35 

1 

1 

17. 

5 

-11 

|  0. 

20 

3 

0 

0. 

0 

0-0 

i  o. 

35 

i 

0 

0. 

0 

0-1 

3  0. 

20 

I 

3 

13. 

6 

1-0 

1  o. 

40 

i 

0 

0. 

0 

1-1 

1  0. 

05 

1 

0 

0. 

0 

00- 

1  0. 

15 

\ 

3 

3. 

75 

01- 

i  o. 

40 

1 

0 

0. 

0 

10- 

1  o. 

30 

I 

2 

7. 

5 

11- 

1  0. 

15 

3 

1 

3. 

75 
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step_2 

2-cubes  |  prob.  |  action  J  first  dash  | second  dash 


—  0 

i  0.75  1 

0  | 

0.0  | 

17.5* 

—  1 

|  0.25  | 

0  | 

13.6*  | 

0.0 

-0- 

j  0.45  J 

0  | 

11.25*  j 

0.0 

-1- 

|  0.55  j 

0  1 

3.  75  | 

17.5* 

0-- 

1  0.55  j 

o  I 

3.75  | 

13.6* 

1-- 

|  0.45  | 

o  1 

11.25*  | 

0.0 

*  marks  the  maximal  gain  in  a  row. 
step  3 

3-cube  |  prob.  |  action  \  first  dash  j second  dashjthird  dash 
-  |  1.00  |  0  |  24.85  {  28.75  {  31.1* 

The  cost  of  the  optimal  tree  is  143  -  31.1  =  111.9.  The 
structure  of  the  optimal  tree  can  be  derived  by  tracing  back 
the  maximal  gains  in  the  tables.  The  root  of  the  optimal 

tree  is  C[ 3  ]  as  the  third  dash  of  the  3-cube  has  to  be  split 

up.  The  left  2-cube,  --0,  has  maximal  gain  if  C[ 2 ]  is  split 

up.  The  right  2-cube,  --1,  is  partitioned  in  an  optimal 

manner  if  splitting  up  C[ 1  ].  Continuing  this  process  we  get 
Fig.  2.7. 


-C[  3  ]■ 


-C[  1  > 


•C[  2  ]- 


I 


-C[  1  ]■ 


I 


A[  1  ]  A[  3  ] 


:[2> 


A[3] 


A[  2] 


A[2] 


A[  1  ] 


Fig.  2.7  Optimal  tree  of  Example  1  if 
testing  ELSE  rule 
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(b)  No  ELSE  rule  test: 
step  0 


0-cubes 

1  prob. 

1 

action 

gam 

000 

|  0.15 

1 

3 

0.0 

001 

s  0.00 

\ 

-1 

0.0 

010 

1  0.  20 

1 

1 

0.0 

011 

|  0.20 

1 

3 

0.0 

100 

1  0.25 

f 

2 

0.0 

101 

i  0.05 

1 

2 

0.0 

110 

8  0.  15 

1 

0.0 

111 

1  0.00 

i 

-1 

0.0 

step_j. 

1 -cubes 

1  prob. 

i 

action 

gain 

-00 

|  0.  40 

1 

0 

0.0 

-01 

I  0.05 

1 

2 

2.5 

-10 

1  0.35 

1 

1 

17.  5 

-11 

1  0.  20 

1 

3 

10.0 

0-0 

|  0.35 

1 

0 

0.0 

0-1 

\  0.  20 

1 

3 

13.6 

1-0 

1  0.  40 

1 

0 

0.0 

1-1 

1  0.05 

1 

2 

3.4 

00- 

i  0.  15 

i 

3 

3.75 

01- 

1  0.  40 

1 

0 

0.0 

10- 

1  0.30 

1 

2 

7.5 

11- 

|  0.  15 

1 

1 

3.75 

ste£_2 

2-cubes 

|  prob. 

I 

action 

1  first 

—  0 

S  0.75 

I 

0 

1  0 

—  1 

1  0. 25 

1 

0 

8  17 

-0- 

S  0.45 

i 

0 

I  11 

-1- 

I  0.55 

i 

0 

1  3 

0— 

l  0. 55 

i 

0 

1  3 

1-- 

|  0.45 

i 

0 

I  11 

step  3 

3-cube 

|  prob. 

i 

act  ion 

1  first 

--- 

o 

© 

0 

i 

0 

1  24 

dash  1  second  dash 


0 

1 

17.5* 

0* 

I 

12.5 

25* 

1 

2.  5 

75 

1 

27.5* 

75 

i 

13.6* 

25* 

i 

3.4 

dash  | second  dash  1  third  dash 
85  S  38.75*  j  34.5 
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The  cost  of  the  optimal  tree  (see  Fig.  2.8)  is  143 
38.75  =  104.25. 


-C[  2  ]- 


A[3] 


■C[  1  > 


A[2] 


A[  1] 


■C[  3  > 


A[  3  ] 


Fig.  2.8  Optimal  tree  of  Example  1  if  not 

testing  ELSE  rule 


2 . 3  Conversion  of  Expanded  Extended-Entry  Decision  Tables 

In  this  section  we  will  generalize  the  method  introduced 
in  Section  2.2  to  extended-entry  decision  tables.  We  may 
assume  without  restriction  of  generality  that  entries  in  the 
decision  table  are  natural  numbers  only.  We  say  condition 
C[i]  has  a  range  r[ i ]  if  the  possible  outcomes  of  this  test 
may  be  0, 1 , . . . ,r[ i  ]-1 .  With  this  convention  we  can  handle 
both  limited-entry  decision  tables,  as  extended-entry 
decision  tables  where  all  conditions  have  a  range  of  2,  and 
mixed-entry  tables. 

Enumeration 


First  we  have  to  redefine  the  rule  number  of  an 
elementary  rule.  Whereas  with  limited  entries  the  n-tuple  of 
outcomes  of  the  condition  tests  could  be  interpreted  as 
binary  number,  we  now  need  a  multiple-radix  arithmetic  with 
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bases  (r[  1  j,r[2  ], .  • . ,  r[n  ])  «  The  rale  numbers  range  from  0 
to  the  product  of  the  condition  ranges  minus  1. 

The  number  of  rows  in  the  k-tables,  which  are  no  longer 
Matrices,  is  n  choose  k,  the  same  as  for  the  limited-entry 
table  conversion.  The  number  of  k-cubes  in  a  row  is  the 
product  of  the  ranges  of  the  conditions  which  are  not 
dashed. 

Example;  n=3;  r[  1  ]=4 ;  r[2]=2;  r[3]=3. 

Rule  numbers  range  from  0  to  23. 

Number  of  0-cubes:  4*2*3=  24 

Number  of  1-cubes;  4*2-8-4*3+2*3=26 

Number  of  2-cubes:  4+2<-3=  9 

Number  of  3-cubes:  1 

0  1  2  3  4  5  6  7  8  9  10  11  f#  of  columns 

-00  -01  -02  -10  -11  -12  I  r[  2  ]r[  3  ] 

0-o  0-1  0-2  1-0  1-1  1-2  2-0  2-1  2-2  3-0  3-1  3-2  j  r[1]r[3] 

00-  01-  10-  11-  20-  21-  30-  31-  1  r[ 1  ]r[ 2  ] 

Fig.  2.9(a)  1-table 

0  1  2  3  | #  of  columns 

--0  --1  --2  1  r[ 3 ] 

-0-  -1-  |  r[  2 ] 

0--  1—  2--  3--  I  r[  1  ] 

Fig.  2.9(b)  2-table 

If  we  split  up  a  k-cube  testing  a  condition  C[i]  the 
number  of  (k-1) -cubes  equals  the  range  of  C[i].  The  row  of 
the  (k-1) -table  in  which  these  cubes  are  listed,  is 
determined  by  the  position  of  the  remaining  dashes.  The 
number  of  entries  in  the  row  of  the  (k-1) -table  is  r[i] 
times  greater  than  the  number  of  k-cubes  to  be  combined  of 
these  (k-1) -cubes.  Splitting  up  a  k-cube  into  r[  i  ]  (k-1)- 
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cubes,  the  entries  of  these  (k-1) -cubes  are  "equidistant” , 
i.e.  the  column  difference  is  constant  and  determined  by  the 
k-cube  and  the  dash  split  up.  The  column  difference  is  the 
product  of  the  ranges  of  the  conditions  which  are  (1) 
higher-numbered  than  the  dash  split  up,  and  (2)  not 
represented  by  a  dash.  For  example,  if  we  split  up  the 
second  dash  of  -01-1 0-,  the  column  difference  will  be 
r[5]*r[6]. 

Assume  for  example  we  want  to  combine  the  2-cubes  in  the 
first  line  of  the  2-table  in  Fig.  2.9  out  of  the  1-cubes  in 
the  second  row  of  the  1-table.  As  r[  1 ]  is  4,  we  have  to 
combine  four  1-cubes,  and  the  column-dif f erence  is  r[3]=3. 
Thus  we  combine  <0,3,6, 9),  (1,4,7,10),  and  (2,5,8,11)  into 
— — 0,  —  -1,  and  --2,  respectively. 

Cost  function 

When  combining  two  subcubes  we  were  able  to  perform  an 
operation  on  the  actions  of  the  subcubes  which  gave  us  the 
action  to  be  assigned  to  the  combined  subcube  and  an 
indication  whether  we  have  to  test  the  combining  condition. 
The  generalization  of  these  operations  is  quite  obvious.  We 
will  combine  both  operations  which  have  been  defined  in  Fig. 
2.5  and  Fig.  2.6.  We  define  a  state  as  a  pair  of  an  action 
number  and  a  Boolean  digit  which  indicates  whether  the 
condition  has  to  be  tested  (=1)  or  not  (=0)  .  We  choose  the 
action  of  any  of  the  subcubes  to  be  combined  (say  A[  i ])  and 
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start  with  state  (A[i],0).  For  each  of  the  remaining 
subcubes  we  perform  a  transition  according  to  the  transition 
matrix  in  Fig.  2.10.  For  example*  if  we  have  to  combine 


subcubes 

with  actions 

A[  1],  A[-1], 

A[  0  ]  * 

we 

get 

(A[1],0) 

=  > 

(A[1],0)  => 

(A[0],1)  . 

I 

A[-1] 

A[0] 

A[  j] 

if 

j>0 

(A[-1],0) 

! 

1 

1 

f 

i 

s 

1 

i 

1 

1 

<A[-1],0) 

(A[  0],0) 

(A[  3],0) 

(A[0],0) 

(A[  0  ]*  0) 

( A[  0  ]  *  1 ) 

(A[  0  ]*  1) 

(A[  i  ]  ,0) 

(A[i],0) 

(A[0],1) 

(A[i],0) 

(AC  01,1) 

if 

if 

i=j 

i*j 

(A[0],1) 

(A[  0  ],  1 ) 

(A[0],1) 

(AC  01,  1) 

<A[i],1) 

C  A[  i  ]  r  1 5 

(A[0],1) 

(A[i],1) 

(A[0],1) 

if 

if 

i=j 
i#  j 

Fig.  2. 

10  Transition 

matrix 

With  this  generalization  the  calculation  of  the  cost  of 
a  subtree  is  completely  analogous  to  the  case  of  limited 
entries.  One  way  to  store  the  structure  of  a  k-cube  is  to 
store  the  pointer  to  the  leftmost  (k-l)-cube  and  the  column- 
difference  together  with  the  root  condition  which  implies 
the  number  of  (k-1) -cubes  to  be  combined. 

Example  2 


condition:  range:  cost: 

C[  1  ]  3  20.0 

C[ 2  ]  2  50.0 

C[ 3  ]  4  30.0 
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rule# 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

C[1]  1 

0 

0 

0 

0 

0 

0 

0 

0 

1 

1 

1 

1 

C[2]  i 

0 

0 

0 

0 

1 

1 

1 

1 

0 

0 

0 

0 

C[3]  | 

0 

1 

2 

3 

0 

1 

2 

3 

0 

1 

2 

3 

action 

2 

-1 

3 

1 

-1 

3 

-1 

3 

1 

3 

3 

prob. 

.05 

.00 

.03 

.10 

.00 

.20 

.00 

.00 

.02 

.05 

.05 

.03 

rule# 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 

23 

C[  1]  | 

1 

1 

1 

1 

2 

2 

2 

2 

2 

2 

2 

2 

C[2]  | 

1 

1 

1 

1 

0 

0 

0 

0 

1 

1 

1 

1 

C[  3  ]  | 

0 

1 

2 

3 

0 

1 

2 

3 

0 

1 

2 

3 

action 

2 

2 

1 

3 

-1 

3 

-  1 

-1 

1 

2 

-1 

1 

prob. 

.12 

.05 

.04 

.05 

.00 

.06 

.00 

.00 

00 

o 

• 

.  02 

.00 

.05 

step  0 


0-cubes 

J  prob.  \ 

action 

gain 

000 

t  0.05  1 

2 

0.0 

001 

f  0.00  ? 

-1 

0.0 

002 

5  0.03  \ 

3 

0.0 

003 

J  0. 10  | 

1 

0.0 

010 

j  0.00  8 

-1 

0.0 

011 

\  0.20  S 

3 

0.0 

012 

|  0.00  \ 

-1 

0.0 

013 

|  0.00  1 

-1 

0.  0 

100 

I  0.02  1 

3 

0.0 

101 

5  0.05  j 

1 

0.0 

102 

S  0.05  \ 

3 

0.0 

103 

5  0.  03  \ 

3 

0.0 

110 

|  0.12  8 

2 

0.0 

111 

{  0.05  | 

2 

0.0 

112 

j  0.04  \ 

1 

0.0 

113 

j  0.05  ? 

3 

0.0 

200 

|  0.00  \ 

-1 

0.0 

201 

|  0.06  | 

3 

0.0 

202 

I  0.00  J 

-1 

0.0 

203 

f  0.00  j 

-1 

0.0 

210 

\  0.08  J 

1 

0.0 

211 

|  0.02  5 

2 

0.0 

212 

j  0.00  f 

-1 

0.0 

213 

S  0.05  1 

1 

0.0 
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step  1 


1-cubes 

1  prob.  1 

action 

gain 

-00 

|  0*07  1 

0 

0*0 

-01 

1  0.  1 1  s 

0 

0*0 

-02 

1  0.08  | 

3 

1*6 

-03 

1  0.13? 

0 

0.0 

-10 

1  0.20  i 

0 

0*0 

-11 

I  0.27  I 

0 

0.0 

-12 

|  0.04  1 

1 

0.8 

-13 

|  0. 10  1 

0 

0.0 

0-0 

1  0.05  1 

2 

2.5 

0-1 

s  0.20  \ 

3 

10.0 

0-2 

\  0*03  1 

3 

1.5 

0-3 

|  0.10  | 

1 

5.0 

1-0 

f  0.14f 

0 

0*0 

1-1 

1  0.10  1 

0 

0.0 

1-2 

|  0.09  1 

0 

0.0 

1-3 

|  0*08  1 

3 

4.0 

2-0 

|  0*08  f 

1 

4.0 

2-1 

f  0*08  1 

0 

0.0 

2-2 

|  0.00  1 

-1 

0*0 

2-3 

1  0.05  1 

1 

2.5 

00- 

1  0.18| 

0 

0*0 

01- 

l  0.20  1 

3 

6.0 

10- 

|  0*151 

0 

0.0 

11- 

1  0.26  1 

0 

0.0 

20- 

|  0.06  1 

3 

1*8 
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8  0.151 

0 

0.0 

step  2 
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1  prob.  1 

action 

1 

first  dash 

| second  dash 

—  0 

f  0.27  1 

0 

1 

6*5* 

1 

0.0 

—  1 
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0 

1 

10.  G* 

i 

0.0 

—  2 

|  0.121 

0 

i 

1.5 

I 

2.4* 

—  3 

1  0.23  | 

0 

I 

11.5* 

S 

0.0 

-0- 

\  0.39  § 

0 

1 

1  *  8* 

! 

1*6 

-1- 

|  0.61  l 

0 

1 

6.  0 * 

S 

0.8 

0-- 

\  0*38  f 

0 

1 

6*0 

\ 

19*0* 

1-- 

1  0*41  | 

0 

1 

0.0 

l 

4 . 0* 

2-- 

|  0.21  1 

0 

i 

1.8 

i 

6*5* 

step  3 

3-cube |  prob.  J  action  |  first  dash  J second  dash  |  third  dash 
— -  s  1.00  1  0  i  29*5  |  7*8  |  30*4* 
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The  cost 

of 

the 

optimal  tree  is  100.0  - 

30.4  =  69.6. 

The  optimal 

tree 

is 

shown  in  Fig.  2.11 

where  the 

probabilities  are  attached  to  the  nodes. 


C[  3  ] 
[1.00] 
I 


r 

I 


cm 

[.27] 

I 


I 

C[  1] 
[.38] 


\ 


I 

C[  2  ] 

[.12] 


I 


I 

C[  1] 
[.23] 
i 


i - i 

!  I  i 
A[  2  ]  C[  2  ]  A[  1  ] 
[  .05][  .  1  4  ][  .08] 
I 


c - i 

I  i  I 
A[3]  C[  2  ]  C[  2  ] 
[  .  20  ][  .  1  0  ][  .  08  ] 
i  i 


i - E  I - 1 

I  I  I  I  I 
A[  3  ]  A[  1  ]  A[  1  ]  A[  3  ]  A[  1  ] 
[  .08  ][  .  04  ]  [  .  10][  .  08  ][  .  05] 


t, - !  I - 8  . - ! 

1  I  I  I  I  I 

A[  3  ]  A[  2  ]  A[  1  ]  A[  2  ]  A[  3  ]  A[  2  ] 

[.02]  [.12]  [.05]  [,05][.06]  [.02] 


Fig.  2.11  Optimal  tree  of  Example  2 


2 . 4  Conversion  of  Compressed  Decision  Tables 

In  Section  1.5  we  said  we  will  adopt  the  convention  that 
the  probability  of  a  combined  rule  is  to  be  split  up  equally 
among  the  elementary  rules  comprising  this  rule.  In  Section 
1.3  we  defined  a  partition  of  the  set  of  elementary  rules. 
One  subset  was  the  set  of  rules  that  an  action  has  been 
explicitly  assigned  to  in  the  decision  table,  another  subset 
contained  the  logically  impossible  rules,  and  all  other 
rules  had  been  assigned  a  common,  unique  action,  the  ELSE 
rule.  With  these  principles,  whenever  the  decision  table 
contains  combined  rules,  we  can  transform  it  in  an  expanded 
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table  and  apply  the  algorithm  of  Sections  2.2  and  2.3.  This 
transformation  is  certainly  possible  for  extended  entries, 
too.  However,  we  will  confine  ourselves  in  the  following 
examples  to  limited  entries.  For  both  examples  the  optimal 
cost  claimed  in  [¥erhelst72]  is  incorrect,  and  we  will 
comment  on  these  examples  later  in  this  section. 


Example  3.  (No  ELSE  test) 


1  prob 

I— — ■ 

«  C[1] 

«  c[  2] 

I  C[  3  ] 


0.20 


0.50 


0.30 


1  cost  : 


§ 


N 

N 


N 

Y 


Y 

Y 


I 


20.0 

10.0 

5.0 


I  A[1]  A[  2  ]  A[3]  1  35.0 


Fig.  2.12  Decision  table  of  Example  3 

([  Verhelst72  ]) 


0-cubes 

prob . 

act 

000 

0.20 

1 

001 

0.00 

-1 

010 

0.25 

2 

011 

0.25 

2 

100 

0.00 

-1 

101 

0.00 

-1 

110 

0.00 

-1 

111 

0.30 

3 

Optimal 

tree : 

■C[  3  ]■ 


A[ 


I 

1] 


*C[  2  ]- 


A[  2  ] 


-C[1> 


A[  2] 


A[3] 


Cost:  20.5. 


-72- 


Exaraple  4.  (No  ELSE  test) 


f  prob.:  0.10 
1 — - - 

f  C[  1  ]  S  N 

S  C[2]  f  N 

1  C[3]  §  N* 

|  C[4]  1  N* 


0.30  0.05  0.20 


N  -  Y 

Y  Y* 

Y*  N 

Y 


0.35  1  cost:  | 

- 1 

Y  1  60.0  S 

Y*  |  5.0  1 

I  |  20.0  | 

»  |  11.0  1 

- 1 

96.0  | 


N  Y  N* 


I  A[  1  ]  A[  2  ]  A[  3  ]  A[  4  ]  A[  5  ]  \ 

i . 


Fig.  2.13  Decision  table  of  Example  4 

([  Verhelst72  ]) 


step  0 


0-cubesS 

prob .  S 

action 

gain 

0000 
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0.  10  I 
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0.0 

000  1 

! 

0.00  1 

-1 

0.0 

0010 

1 

0.00  i 

-1 

0.0 

001  1 

1 

0.00  1 

-1 

0.0 

0100 

i 

0.15  f 

2 

0.0 

010  1 

1 

0.00  | 

**1 

0.0 

0110 

i 

0.15  \ 

2 

0.0 

011  1 

0.025| 

3 

0.0 

1000 

i 

0.10  1 

4 

0.0 

1001 

f 

0.00  f 

-1 

0.0 

101  0 

§ 

0.00  1 

-1 

0.0 

101  1 

1 

0.00  1 

-1 

0.0 

1100 

! 

0.10  1 

4 

0.0 

110  1 

1 

0.00  S 

-1 

0.0 

1110 

I 

0.35  1 

5 

0.0 

1111 

i 

0.0251 

3 

0.0 
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step  4 

split  up  dash:  gain  of  4-cube: 

1  14.675 

2  16.2* 

3  11.7 

4  15.0 

The  cost  of  the  optimal  tree  is  96.0  --  16.2  =  79.8. 


r - - - - - — C[  2  > - — - 

1  I 

r— — C[  1  ] - ,,  i - C[  4  }- 

1  1  i 

A[  1  ]  A[  4  ]  r- - - — C[  1  ] - , 

!  f 

A[  2  ]  r- - C[  3  ] - 1 

§  § 
A[4]  A[  5  ] 


I 

A[3] 


In  [Verhelst72]  an  optimum  approaching  and  an  optimum 
finding  algorithm  have  been  proposed.  Both  algorithms  are 
based  on  the  lower  bound  of  the  cost  of  the  decision  trees 
as  derived  from  a  compressed  decision  table.  The  lower 
bound  S  is  calculated  as 

n 

S  =  SUM  (t[ i  ]*  SUM  prob  ( j) ) 

i=1  j 

where  the  inner  sum  is  over  all  entries  j  which  are  not 
starred  or  dashed  for  condition  C[ij*  and  t[i]  is  the  cost 
of  testing  condition  C[i].  For  example*  for  the  decision 
table  in  example  3*  S  is  calculated  as  28.5.  However*  as  we 
saw*  the  optimal  tree  has  a  cost  of  only  20.5.  In  example 
4*  the  tree  obtained  with  ¥erhelst*s  optimum  finding 
algorithm  starts  with  C[ 4  ]  and  has  a  cost  of  81.0  as  opposed 
to  the  optimum  79.8.  Note  that  in  step  4  we  also  found  the 
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suboptimal  tree  which  starts  with  C[ 4 ]  and  has  a  gain  of 


15.0. 


King  and  Johnson  gave  a  first  counter-example  where  S  is 
incorrect  [King74].  In  that  counter-example  an  implied 
entry  had  been  combined  with  a  non-implied  entry  thus  losing 
the  information  that  for  one  elementary  rule  one  condition 
need  not  be  tested.  As  Verhelst  pointed  out  in  his  reply 
[ Verhelst74  ],  the  lower  bound  S  is  not  valid  in  exactly 
these  cases. 


A.  consequence  of  this  is  that  S  in  general  may  be 
invalid  if  the  set  of  logically  impossible  rules  is  non¬ 
empty.  S  is  calculated  for  the  particular  rule  partition 
specified  in  the  decision  table.  Usually  the  rule  partition 
is  not  unique,  and  the  value  of  S  may  differ  for  different 
rule  partitions.  In  the  justification  of  S  it  is  said: 


"The  action  part  of  a  particular  rule  is  reached  when 
the  algorithm  produces  an  empty  subtable  or  a  subtable 
consisting  of  one  column.  Theoretically  it  would  be 
possible  for  some  conditions  in  this  column  to  be  neither 
dashed  nor  starred.  Assuming  that  the  table  does  not 
contain  an  ELSE-rule,  this  would  then  mean  that  for  that 
rule  at  least  one  condition  which  is  not  starred  or  dashed 
does  not  have  to  be  tested,  in  which  case  S  would  be  lower 
than  stated  above.  If,  however,  such  a  case  arose,  it  would 
mean  that  in  preparing  the  table  one  has  forgotten  to  star 
those  conditions. "  [ Verhelst72 ], p. 975. 

However,  the  way  of  increasing  the  number  of  implied 
entries  in  the  table  is  not  unique.  In  example  3  we  could 
rewrite  the  decision  table  for  instance  as 
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To  be  sure  that  we  find  an  S  which  is  not  greater  than 
the  minimum  of  all  these  bounds  we  have  to  proceed  in  the 
way  of  Reinwald  and  Soland.  This  involves  maximizing  the 
gains  for  each  row  separately ,  which  in  this  case  yields 
S=15 *  5. 


2 . 5  Some  Comments  and  Comparisons 

Being  familiar  with  the  techniques  employed  in  the 
dynamic  programming  algorithm,  it  is  quite  obvious  how  to 
implement  Ganapathy8s  and  Rajaraman®s  algorithm  efficiently* 
Starting  with  the  n-cube,  subcubes  are  split  up  to  smaller 
cubes  until  a  partition  is  found  consisting  only  of  subcubes 
with  action  numbers  >0.  (The  subtrees  corresponding  to 
these  subcubes  are  simply  leaves  representing  the  actions  to 
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be  performed  after  having  selected  a  rule) .  The  structure 
of  the  decision  tree  can  be  represented  in  form  of  a 
permutation  of  the  rule  numbers  where  the  initial 
permutation  is  the  natural  order. 

Suppose,  the  decision  tree  has  been  developed  for  the 
upper  n-k  levels.  Then  the  permutation  of  rule  numbers 
should  be  considered  as  divided  in  2**  (n-k)  (2**^ -tuples 
which  represent  the  k-cubes.  For  each  of  the  k  conditions 
of  a  k-cube  we  have  to  determine  the  dash  entries  and  the 
sum  of  the  probabilities  pO  and  pi  of  being  a  NO  or  YES, 
respectively,  for  all  non-dash  entries.  For  each  of  the  k 
conditions  we  just  have  to  compare  all  pairs  of  rule  numbers 
with  a  difference  of  1,  2,  ...,  2**(k-1)  in  the  position 
within  the  (2**k)  -tuple.  If  actions  of  both  rules  are 
identical  or  at  least  one  of  the  rules  is  logically 
impossible  both  rules  could  be  combined  thus  having  a  dash 
entry.  Otherwise  we  add  the  probabilities  of  the  left  and 
right  rules  to  pO  and  pi,  respectively. 

Having  selected  a  condition,  the  rule  numbers  in  the 
(2**k) -tuple  have  to  be  reordered  such  that  all  rule  numbers 
corresponding  to  the  NO-outcome  of  the  condition  test  are  in 
the  left  half  of  the  tuple  and  the  rules  with  a  YES-outcome 
in  the  right  half.  This  can  be  done  in  the  same  way  as  the 
determination  of  the  dash  entries. 


The  determination,  of  the  probabilities  pO  and  pi  for  a 
condition  is  linear  in  the  number  of  rules  in  the  k-cube. 


-77- 


Using  a  method  without  binary  rule  numbers,  the 
determination  of  the  dash  entries  is  at  least  of  quadratic 
order.  The  conversion  time  of  that  straightforward 
implementation  proved  to  be  higher  by  at  least  one  order  of 
magnitude  for  large  decision  tables  compared  to  the  time 
required  when  employing  the  techniques  described  above. 

Instead  of  developing  the  decision  tree  level  by  level 
it  is  more  efficient  to  expand  the  tree  in  a  way  similar  to 
the  preorder  traversal  of  binary  trees  [Knuth68].  Before 
expanding  a  node  it  is  checked  whether  the  action  number  of 
the  subcube  is  >0.  In  this  case  a  leaf  is  reached  and 
backtracking  takes  place. 

Note  that  for  this  implementation  the  conversion  time  is 
virtually  independent  of  whether  the  ELSE  rule  is  tested  or 
not. 


Another  method  for  finding  near-optimal  decision  trees 
can  be  derived  from  the  branch -and- bound  algorithm  of 
Section  2.1.  Using  a  depth-first  strategy  in  the 
partitioning  process  and  always  selecting  for  expansion  the 
block  with  minimum  cost  among  those  generated  in  the 
previous  stage,  a  feasible  solution  can  be  found  quickly. 
If  we  stop  after  having  found  this  first  solution  instead  of 
improving  it  or  checking  its  optimality,  we  can  consider 
this  depth-first  search  method  as  a  heuristic.  Experiments 
with  n<6  conditions  have  shown  that  the  decision  trees 
obtained  with  the  depth-first  heuristic  on  average  have 
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lower  expected  execution  time  than  those  obtained  with 
Ganapathy®s  algorithm.  A  detailed  comparison  of  both 
methods  revealed  that  Ganapathyes  method  may  sacrifice  some 
potential  gains  in  the  second  lowest  level  of  the  decision 
tree  where  the  choice  between  only  two  conditions  is  left. 
The  bound  increments  calculated  in  this  level  determine  the 
final  cost  of  the  tree.  Having  reached  this  level*  the 
condition  with  the  lower  bound  increment  is  certainly  the 
better  choice  as  the  entropy  measure  at  best  indicates  the 
condition  which  more  probably  yields  the  tree  with  lower 
cost. 

Although  the  depth-first  heuristic  can  be  expected  to 
achieve  better  results  than  Ganapathyes  algorithm  the  former 
method  is  much  more  expensive  than  Ganapathy*s.  Its 
conversion  time  increases  more  exponentially  than  the 
latter*s  as  the  number  of  conditions  increases.  However* 
Ganapathy*s  algorithm  may  be  improved  slightly  by 
calculating  the  bound  increments  instead  of  calculating  the 
entropies  at  the  second  lowest  level.  When  deciding  which 
condition  in  a  2-cube  to  test  first*  for  both  conditions 
again  the  probabilities  p (i)  of  the  rules  with  a  dash  entry 
are  determined.  However*  instead  of  calculating  the 
entropies  we  select  the  condition  C[ i ]  which  has  the  smaller 
product  of  p(i)  and  the  cost  of  testing  C[i].  This  does  not 
increase  the  conversion  cost  at  all.  The  trees  obtained 
with  this  modified  algorithm  never  have  higher  costs  and 
often  lower  costs  than  the  trees  obtained  with  the  original 
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algorithm  .  Converting  tables  with  four  and  five  conditions* 
we  could  marginally  improve  the  trees  obtained  with  the 
original  algorithm  in  one  third  of  those  cases  where  the 
optimal  tree  had  not  been  achieved. 

On  the  assumption  that*  in  general*  decision  tables  have 
to  be  specified  in  expanded  form  in  order  to  be  able  to  find 
the  optimal  decision  tree,  the  number  of  steps  for 
converting  decision  tables  to  decision  trees  grows 
exponentially  with  the  number  n  of  conditions  as,  for 
example  for  limited  entries,  each  of  the  2**n  elementary 
rules  has  to  be  encountered  at  least  once.  Thus  the  order 
of  any  conversion  algorithm  must  be  at  least  2#^n.  The 
order  of  the  optimal  conversion  algorithm  is  still  unknown. 

An  implementation  of  the  dynamic  programming  algorithm 
of  Section  2.2  is  given  in  Appendix  A.  For  limited  entries 
the  storage  requirement  for  conversion  of  a  table  with  n 
conditions  is  of  order  3**n.  We  estimate  that  the  CPU  time 
needed  is  also  of  order  3*«n.  An  analysis  of  the 
implementation  described  for  the  Ganapathy  algorithm  yields 
that  the  order  of  this  algorithm  is  n2*2**n. 

We  ran  both  algorithms  on  the  IBM/370-165-11  of  the 
University  of  Toronto  Computer  Centre  using  the  PL/1 
Optimizing  Compiler  for  a  fairly  large  number  of  random 
limited-entry  decision  trees.  Fig.  2.14  gives  a  comparison 
of  the  average  CPU  time  in  seconds  needed  for  the  conversion 
of  one  decision  table  with  n  conditions.  The  values  for  the 


-80- 


dynamic  programming  algorithm  which  were  obtained  with  the 
program  listed  in  Appendix  A,  could  be  slightly  improved  by 
using  a  program  restricted  to  limited  entries.  With  a  less 
efficient  implementation  not  using  rule  numbers  the  times 
obtained  for  the  heuristic  method  were  considerably  higher 
than  for  the  dynamic  programming  method. 


5  n  I  5  ?  6  \  1  \  81  9f  10! 

I - - - - - - - - - - - S 

\ Ganapathy  |  0.05  |  0.08  \  0.16  5  0.34  \  0.81  \  2.1  \ 
j  Dyn.  Prog . j  0.05  j  0.10  j  0.25  8  0.69  j  2.04  |  6.0  | 

i _ _ _ _ _ _ _ _ ; 


Fig.  2.14  CPU  time  (in  secs)  for  conversion 
of  one  decision  table 
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3  •  Conversion  to  Decision  Trees  of  Minimum  Storage 
Be  cm  ire  merits 

3. 1  Storage  Minimization  without  Action  Hoisting 

Because  the  minimization  of  storage  space  required  for  a 
program  representing  a  decision  tree  is  not  as  important  as 
the  minimization  of  the  program’s  average  execution  time^ 
fewer  algorithms  have  been  proposed  than  for  time 
minimization.  In  Section  1.6  we  discussed  briefly  the  basis 
of  a  heuristic  algorithm  by  Pollack.  Reinwald  and  Soland 
developed  an  optimum  finding  branch-and-bound  algorithm 
quite  similar  to  the  one  discussed  in  2.1.1  [Reinwald67  ]. 
These  algorithms  consider  only  the  storage  costs  of  the 
condition  tests.  In  this  chapter  we  shall  describe  a 
dynamic  programming  algorithm  which  finds  a  decision  tree  of 
total  minimum  storage  requirement  for  condition  tests  and 
actions.  In  this  section  we  shall  still  assume  that 
condition  tests  and  actions  are  not  to  be  intermixed.  In 
Section  3.2  the  more  general  case  where  actions  may  be 
,shoistedfi9  in  the  decision  tree  will  be  considered. 

The  format  of  the  decision  tables  we  want  to  consider  in 
this  chapter  is  slightly  different  from  the  tables  in  the 
previous  chapter.  Obviously a  when  seeking  decision  trees 
with  minimum  storage  requirements,  the  probabilities  of  the 


-82- 


rules  are  not  important.  We  assume  that  a  set  of  actions  is 
associated  with  each  rule  rather  than  a  single  action  only. 
We  shall  denote  each  single  action  as  a[ij.  The  same  action 
number  A[ j  ]  will  be  assigned  to  the  action  sets  of  the  rules 
having  identical  action  sets.  Again  action  number  A[-1] 
denotes  logically  impossible  rules.  We  shall  assume  fixed, 
known  costs  for  the  storage  needed  for  each  condition  test 
and  each  action. 

The  enumeration  of  the  subcubes  is  again  accomplished  by 
the  algorithm  in  Chapter  2.  Therefore  we  will  describe  only 
the  cost  function.  Since  the  storage  cost  of  a  complete 
decision  tree,  unlike  its  average  execution  time,  depends  on 
the  structure  of  the  tree,  we  cannot  maximize  the  gain  of 
subtrees  and  subtract  the  maximum  gain  from  a  maximum  cost. 
Bather  we  have  to  calculate  the  cost  of  the  subtrees 
directly „ 

Again  we  assign  an  action  to  each  subcube.  When 
combining  subcubes,  the  action  of  the  resulting  subcube  and 
the  necessity  of  testing  the  combining  condition  are 
determined  as  in  Section  2.3  using  the  transition  matrix  in 
Fig.  2.10.  This  procedure  remains  valid  here  since  it  is 
independent  of  the  optimization  objective.  The  cost  of  the 
resulting  k-cube  is  calculated  as  follows.  If  the  combining 
condition  has  to  be  tested,  the  cost  is  simply  the  sum  of 
the  cost  of  the  (k-1) -cubes  plus  the  cost  of  the  combining 
condition.  If  the  combining  condition  need  not  be  tested. 
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the  cost  is  the  maximum  of  the  costs  of  the  (k-1)  -cubes. 
This  can  be  seen  as  follows.  The  (k-1) -cubes  can  be  divided 
into  two  subsets,  one  containing  (k-1) -cubes  with  A[i],  i>0, 
and  one  consisting  of  the  subcubes  with  A[-1]«  The  latter 
ones  have  cost  0.  The  subcubes  with  A[ i  ]  must  have 
identical  cost  and  identical  optimal  partitions  as  the 
storage  cost  does  not  depend  on  the  position5®  of  the 
subcube  as  there  are  no  probabilities  involved  which  might 
influence  the  cost  of  the  subcubes.  The  cost  of  the  k-cube 
equals  this  cost.  If  all  (k-1) -cubes  have  A[-1],  the  cost 
of  the  k-cube  obviously  is  0. 

For  conditions  with  more  than  two  possible  outcomes  it 
can  occur  that,  although  the  condition  test  cannot  be 
replaced  by  an  action,  some  of  the  outcomes  may  lead  to  the 
same  action  or  identical  subtree.  In  these  cases  the 
branches  corresponding  to  these  outcomes  could  be  merged. 
However,  we  do  not  consider  this  generalization  here,  rather 
we  require  that  each  condition  test  provides  branching  to  as 
many  different  subtrees  or  actions  as  there  are  possible 


outcomes. 
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Fig.  3.1  Decision  table  of  Examples  5  and  6 


As  an  example  we  derive  the  decision  tree  of  the  table 
in  Fig.  3.1.  In  step  0  a  unique  action  number  is  assigned 
to  each  action,  and  the  cost  of  the  elementary  rules  is  the 
sum  of  the  costs  of  the  actions  associated  with  this  rule 
which  is  some  measure  of  the  storage  space  required  for  the 
action  itself  or  for  a  calling  sequence  to  a  subroutine 
which  performs  the  action. 
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Fig.  3.2  Decision  tree  derived  in  Example  5 


The  decision  tree  derived  (see  Fig.  3.2)  has  a  cost  of 
85.0.  Applying  action  hoisting  to  this  generated  tree 
results  in  a  simpler  tree  of  cost  69.0  (see  Fig.  3.3).  In 
the  next  section  we  will  apply  action  hoisting  to  each 
subtree  and  thus  obtain  a  tree  of  even  lower  cost. 
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Fig.  3.3  Decision  tree  obtained  when  hoisting 
actions  the  tree  in  Fig.  3.2 
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3 • 2  Storage  minimisation  with  Action  Hoisting 

The  algorithm  which  includes  hoisting  is  an  extension  of 


the  algorithm 

given 

in  Section 

3.  1. 

At 

the 

beginning 

the 

action  sets 

given 

in  the 

expanded 

decision 

table 

are 

assigned  to  the  0-cubes.  If 

the 

sequence 

in 

which 

the 

actions  are  to  be  performed  is  not  predefined  we  simply 
represent  the  action  set  as  a  bit  vector.  If  we  combine  (k- 
1) -cubes  to  a  k-cube,  the  actions  to  be  hoisted  are  given  by 
the  conjunction  of  the  action  vectors  of  the  (k-1) -cubes. 
Note  that  the  actions  hoisted  are  not  dependent  on  the 
structure  of  the  subtree.  In  addition  to  the  action  vector 
we  assign  two  bits  to  each  k-cube.  One  (same-action) 
indicates  whether  all  logically  possible  rules  in  the  k-cube 
have  identical  action  sets.  If  so,  the  k-tree  corresponding 
to  the  k-cube  is  simply  a  leaf  of  the  decision  tree 
representing  the  set  of  actions  defined  in  the  action  vector 
of  the  k-cube.  The  other  (excludable)  indicates  whether  all 
0-cubes  in  the  k-cube  are  logically  impossible. 

The  action-hoisted  vector,  same-action  and  excludable 
replace  the  action  number  of  a  k-cube  which  has  been  used  in 
Chapter  2  and  Section  3.1.  Action  number  A[ - 1 ]  corresponds 
to  excludable  being  true;  A[i],  i>0,  means  same-action  is 
true  where  the  action-hoisted  vector  determines  i;  and  A[ 0 ] 
means  same-action  is  false.  In  the  last  case,  the  action- 
hoisted  vector  specifies  which  actions  are  common  to  all 
logically  non -excludable  0-cubes.  Thus,  when  combining  (k- 
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1) -cubes,  we  can  determine  in  exactly  the  same  way  as  in  the 
previous  algorithm  whether  the  combining  condition  must  be 
tested  or  not.  If  it  is  not  to  be  tested,  all  of  the  (k-1)- 
cubes  with  excludable  being  false  must  have  the  same  action 
set,  and  the  cost  of  the  k-cube  equals  the  cost  of  these  (k- 
1) -cubes.  If  the  combining  condition  has  to  be  tested,  the 
cost  of  the  k-cube  equals  the  sum  of  the  costs  of  the  (k-1)- 
cubes  plus  the  cost  of  the  condition  test.  However,  this 
cost  can  be  reduced  if  any  action  can  be  hoisted  above  the 
combining  condition.  If  m  (k-1) -cubes  with  excludable  false 
are  combined  and  h[i]  is  the  cost  of  an  action  a[i],  the 
cost  is  to  be  decreased  by  (m-1)*h[i]  for  each  a[i]  hoisted. 

As  an  example  we  will  convert  the  decision  table  of  Fig. 
3.1.  Because  the  conjunction  of  action-hoisted  vectors  must 
be  built,  we  will,  by  convention,  set  action-hoisted  to  all 
true  and  same-action  is  true  whenever  excludable  is  true. 
For  each  0-cube  same-action  is  true  and  cost  is  the  sum  of 


the  costs  of  the  associated  actions 
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step  2 
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Fig.  3.4  Decision  tree  derived  in  Example  6 


The  optimal  tree  (see  Fig.  3.4)  has  a  cost  of  61.0 
compared  to  the  cost  of  69.0  of  the  tree  in  Fig.  3.3. 

So  far  we  have  assumed  that  the  sequence  in  which  the 
actions  are  performed  is  arbitrary.  The  extension  to  the 
case  where  the  actions  of  a  rule  are  partially  ordered  is 
quite  obvious.  Instead  of  a  bit  vector  which  defines  the 
action  units  to  be  performed,  we  must  have  a  vector  of 
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integers  which  denote  the  sequence  of  the  actions.  Suppose 
now,  we  want  to  combine  a  number  of  (^-1) -cubes  into  a  k- 
cube.  The  set  of  actions  that  can  be  hoisted  is  known  for 
each  (k- 1) -cube.  The  procedure  which  determines  the  subset 
of  actions  that  can  be  hoisted  above  the  k-cube,  is  the 
following.  Build  for  each  fk- 1} -cube  the  subset  of  those 
actions  which  have  the  lowest  sequence  number  of  the  actions 
of  this  (k- 1) -cube .  Build  the  intersection  of  these 
subsets.  The  actions  in  the  intersection  may  be  hoisted. 
If  not  all  subsets  are  identical,  we  stop.  If,  on  the  other 
hand,  all  actions  in  these  subsets  may  be  hoisted,  we  build 
the  subsets  with  the  next  higher  sequence  numbers  and  repeat 
this  selection  process  until  we  find  non-identical  subsets 
or  all  actions  have  been  hoisted.  Assume,  for  example,  two 
subcubes  have  the  following  action  sets: 


subcube  1  subcube  II 


an]! 

3 

1 

a[  2  1  | 

1 

1 

2 

a[3]  | 

2 

1 

3 

am  1 

i 

4 

a[5]  I 

1 

1 

2 

a[6]  I 
a[7]  | 

2 

I 

First  we  find  that  actions  a[2]  and  a[ 5 ]  may  be  hoisted.  As 
in  both  subcubes  there  are  no  other  actions  of  the  same 
sequence  number,  we  can  proceed  and  find  that  action  a[3] 
also  can  be  hoisted.  As  a[ 6  ]  of  subcube  I  must  not  be 
hoisted,  no  other  of  the  actions  of  subcube  I  may  be 


hoisted,  and  we  stop. 
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4 •  Conclusion 

Reinwald's  and  Soland’s  branch-and-bound  algorithm  for 
conversion  to  time-minimal  decision  trees  can  convert 
decision  tables  of  up  to  five  conditions  with  an  economical 
effort.  With  the  dynamic  programming  algorithm  tables  of  up 
to  eight  conditions  (if  virtual  memory  is  available,  up  to 
twelve  conditions)  can  be  handled.  The  CPU  time  required 
for  converting  limited  entry  tables  of  eight  conditions  is 
less  than  one  second  on  an  IBH/370-165-II ,  for  tables  with 
ten  conditions  about  six  seconds.  The  conversion  time 
needed  for  tables  of  up  to  six  conditions  is  virtually  the 
same  for  the  dynamic  programming  algorithm  and  for 
Ganapathy*s  algorithm.  For  larger  tables  the  conversion 
times  for  the  algorithm  finding  the  optimal  trees  is  higher 
as  the  complexity  of  Ganapathy's  algorithm  is  of  order 
n 2*2**n  compared  to  3**n  for  the  dynamic  programming  method. 
As  opposed  to  the  branch-and-bound  method,  the  conversion 
time  of  the  dynamic  programming  algorithm  is  only  dependent 
on  the  number  of  conditions  but  virtually  independent  of  the 
data. 

In  [Jarvis71]  a  large  number  of  decision  tables  of  two 
projects  has  been  analyzed.  It  has  been  found  that  none  of 
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the  tables 

had  more  than 

ten 

conditions 

and  the 

great 

majority  had 

between  two  and 

six 

conditions. 

This 

means 

that  in  almost  all  cases  in  practice  it  is  feasible  to  look 
for  the  optimal  decision  tree  using  the  dynamic  programming 
algorithm. 

Some  authors  [Woods71,  Montalbano74  ]  emphasize  the 
advantages  of  using  mixed  entries  rather  than  constraining 
oneself  on  limited  entries  only.  As  opposed  to  the 
heuristics  based  on  information  theory ,  the  dynamic 
programming  method  is  capable  of  handling  extended  entries 
as  well  as  limited  entries. 

As  far  as  we  know*  the  dynamic  programming  method  for 
finding  storage-minimal  decision  trees  is  the  first 
conversion  method  including  action  hoisting.  However,  for 
the  problem  of  finding  decision  networks  of  minimum  storage 
requirement,  a  solution  with  dynamic  programming  is  hard  to 
see.  As  we  mentioned  in  Section  1.7,  the  removal  of 
redundant  subtrees  by  means  of  branching  should  be 
considered  as  a  step  which  is  performed  separately  after 
having  found  the  minimal  decision  tree  [  25yers72  ]. 

A  generalization  of  interest  which  is  not  solvable  with 
dynamic  programming,  is  the  minimization  of  functions  of  the 
average  execution  time  and  the  storage  requirement.  As  long 
as  we  confine  ourselves  to  storage  minimization,  two 
subcubes  with  an  identical  action  pattern  will  be  assigned 
identical  optimal  partitions  and  both  subtrees  can  be  merged 
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into  one.  However,  having  in  addition  a  different  pattern 
of  probabilities  in  the  subcubes,  both  subcubes  might  have 
different  optimal  partitions.  The  gain  achieved  by 
combining  two  non-optimal  subtrees  of  the  same  structure 
might  be  greater  than  the  gain  achieved  by  combining  the 
optimal  subtrees  of  different  structure  which  cannot  be 
merged.  Thus,  in  general,  the  optimal  decision  tree  may 
contain  non-optimal  subtrees. 


Appendix  A 


Time- Minimal  Conversion  of  Mixed-Entry  Decision  Tables 


/*  This  algorithm  converts  a  mixed-entry  decision  table  */ 
/*  to  a  decision  tree  of  minimum  average  execution  time.  */ 
/*  In  spite  of  its  generality  the  program  handles  */ 
/*  limited  entries  quite  efficiently  as  in  the  innermost  */ 
/*  loop  conditions  of  range  2  are  treated  separately.  */ 
/*  The  decision  table  passed  to  this  algorithm  has  to  be  */ 
/*  in  expanded  form.  If  the  ELSE  rules  are  to  be  tested*  */ 
/*  these  elementary  rules  should  be  assigned  a  unique  */ 
/*  action  number  >0.  If  the  ELSE  rule  is  not  to  be  tested**/ 
/*  the  logically  impossible  rules  are  defined  by  -1.  */ 

/*  This  program  handles  tables  with  up  to  9  conditions.  */ 
/*  For  larger  tables  the  program  has  to  be  modified  as  the*/ 
/*  array  ranges  become  greater  than  32K  (which  cannot  be  */ 
/*  handled  by  current  PL/1  compilers) .  */ 

/*  To  specify  the  decision  table*  the  following  list  of  */ 
/*  parameters  has  to  be  passed  from  the  calling  program:  */ 
/*  N... number  of  conditions  */ 
/*  CO ND_RANGE  (N)  ..  .range  of  each  condition. Limited  entries*/ 


/* 

have  a  range  of  2.  RuXe_ 

.range*  the 

*/ 

/* 

highest  rule  number*  is 

the  product  of 

*/ 

/* 

the  ranges  minus  1. 

*/ 

/*  C0ND__CG5T (B) . . . average  testing  time  of  each  condition.  */ 
/*  RULE_PROB (0 :RULE_RANGE) ...  probability  of  each  rule  */ 
/*  RULE_ACTXON__#  ( 0 : ROL E_RANGE)  ...  action  number  associated  */ 
/*  with  each  rule.  */ 

/*  The  calling  program  has  to  provide  two  arrays  in  which  */ 
/*  the  decision  tree  will  be  returned.  The  decision  tree  */ 
/*  is  represented  as  a  code  matrix  [Dial70].  Each  line  of  */ 
/*  the  code  matrix  represents  a  node  of  the  tree. The  first*/ 
/*  entry  in  a  line  denotes  the  condition  test  at  this  node*/ 
/*  The  remaining  entries  in  the  line  correspond  to  the  */ 
/*  possible  outcomes  0<x<range (condition) - 1 .  If  x  leads  to*/ 
/*  another  node*  the  entry  for  x  is  the  index  of  the  line  */ 
/*  corresponding  to  that  node.  If  in  case  of  x  a  rule  has  */ 
/*  been  selected*  the  negative  value  of  the  action  number  */ 
/*  of  this  rule  is  stored  in  the  entry  for  x.  A  0-entry  */ 
/*  means  that  this  outcome  of  the  condition  test  is  */ 
/*  logically  impossible.  A  G-entry  is  only  possible  */ 
/*  in  case  of  an  extended  entry.  */ 
/*  The  conditions  are  stored  in  the  vector  TEST  (1 : #_N0DES) */ 
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/*  the  actions  or  links  to  other  nodes  are  stored  in  */ 
/*  TREE (1 : #_NODES, 0 : max_ran ge- 1) ,  where  max_range  is  the  */ 
/*  maximum  range  of  any  condition.  Since  #- NODES  cannot  be*/ 
/*  known  in  advance,  the  calling  program  has  to  allocate  */ 
/*  sufficiently  large  arrays.  The  maximum  number  of  */ 
/*  internal  nodes  of  a  complete  decision  tree  with  the  */ 
/*  given  conditions  would  certainly  be  sufficiently  large.*/ 
/*  For  limited  entry  tables  this  number  is  2**n-1 .  */ 
/*  TGTAL_COST  returns  the  average  execution  time  of  the  */ 
/*  decision  tree  derived.  */ 


/* 
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/* 
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/*  Average  execution  time:  80.87 


*/ 
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time_minimal:  proc  (n*  cond_range*cond_cost  *  rule_prob* 

rule_action_#*  test  *  tree*  #_nodes* 
tot al_cost)  reorder; 

del  (n*cond_range  (*)  *  rule_act  ion_#  (*)  *  #_nodes* test  (*)  * 
tree  (***))  fixed  bin  (15); 

del  (cond_cost  (*)  *rule_prob  (*)  *total_cost)  float  bin; 

/*  The  optimal  partitions  of  all  subcubes  have  to  be  */ 

/*  saved  until  the  end  of  the  algorithm,.  However*  in  orderV 
/*  to  find  the  optimal  partition  of  k-cubes*  only  the  */ 

/*  cost*  probability*  and  action  of  all  (k-1) -cubes  must  */ 
/*  be  known.  The  values  of  1-cubes*  l<k-2 *  are  no  longer  */ 
/*  needed.  Thus*  for  cost*  probability*  and  action  we  */ 

/*  provide  only  storage  for  two  levels  of  subcubes  */ 

/*  concurrently.  We  will  briefly  talk  of  the  short  arrays  */ 
/*  as  opposed  to  the  long  arrays  used  for  storing  the  */ 

/*  optimal  partitions  of  all  subcubes.  We  provide  2  copies*/ 
/*  of  the  short  arrays*  one  for  the  previous  and  one  for  */ 
/*  the  current  level  k.  The  short  arrays  correspond  to  */ 
/*  (k-1)-  and  k-tables.  The  length  of  the  arrays  are;  */ 

/*  SHQRT_SIZE  =  MAX (number  of  k-cubes)  */ 

/*  k  */ 

/*  LQHG  SIZE  =  SUM  (number  of  k-cubes)  */ 

/*  ~  k  */ 

/*  For  limited  entry  decision  tables  LONG__SXZE  is  3**N.  */ 

/*  Previous  levels  of  the  long  array  are  not  needed  before*/ 
/*  the  end  of  the  algorithm.  Thus*  it  would  be  sufficient  */ 
/*  to  allocate  arrays  of  length  SHOBT__SXZE  and  write  them  */ 
/*  on  auxiliary  storage  after  having  completed  a  level  k.  */ 
/*  This  would  reduce  the  storage  requirements  on  the  */ 

/*  expense  of  a  somewhat  longer  conversion  time.  */ 

/*  Limited-entry  tables  with  eight  conditions  can  be  */ 

/*  converted  in  a  200K  bytes  region.  For  twelve  conditions*/ 
/*  an  address  space  of  about  Si  bytes  is  required.  */ 

/*  The  CPU  time  needed  for  conversion  is  listed  in  */ 

/*  Fig.  2. 14.  */ 

/*  When  handling  k-cubes*  the  difference  between  the  */ 

/*  indices  in  the  long  and  short  arrays  for  the  same  */ 

/*  k-cube  is  */ 

/*  ADJUST (k)  =  SUM (number  of  1-cubes)  */ 

/*  l<k-1  */ 

del  (short_size*long_size  *ad  just  (n)  *rule__range* comb  (n)  * 
radix  (n)  *i*ii*j*  jj*k*l)  fixed  bin(15); 
del  (ok* end_comb)  bit(1); 
del  eps  float  bin; 

/*  determine  the  greatest  rule  number  (HULE__jRANGE)  */ 

rule„range=1 ; 
do  i=n  to  1  by  -1 ; 

radix (i) =rule_range ;  /*  multiplier  of  i-th  condition*/ 

rule_range=rule_range*cond_range  (i) ; 
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end; 

rule_range=rule_range- 1 ; 


/*COMB (*)  holds  one  of  n  choose 
/*  combinations  of  conditions. 
/*  END_COMB  is  true  if  all 
/*  combin.  have  been  enumerated 


k*/ 

*/ 

V 

*/ 


/*  determine  ADJUST (*)  ,  SHORT_SIZE  and  LONG_SIZE  */ 

short _size=rule_range ; 
adjust  (1)  =0 ; 
adjust  (2) =rule_range+1 ; 
do  i= 1  to  n-2; 
k=n-i ; 

adjust (i*2)  =0 ; 
do  j=1  to  k; 

comb  { j)  =  j  ; 
end ; 

end_comb=* 0®  b; 
do  while  (-»end_comb)  ; 

jj=1; 

do  j=1  to  k; 

j  j=jj on d_ range  (comb  ( j) )  ; 
end; 

adjust  (i+2)  =ad  just  (i+2)  ♦  j  j ; 
call  next_combination ; 
end ; 

if  adj ust  (i+2)  >short_size  then  short_size=ad just (i+2)  ; 
end; 

iong_size=sum  (adjust)  +  sum  (cond_range)  ; 

/*  ADJUST  (*)  contributes  only  the  number  of  k-cubes  */ 
/*  with  k<n-2 .  For  k=n- 1  there  are  sum  (CCND_ RANGE)  */ 
/*  k-cubes.  */ 

do  i=3  to  n; 

adjust  (i)  =ad  just  (i)  tad  j  ust  (i- 1 )  ; 
end; 

eps=1 „e-6*sum  (cond_cost)  ;  /*  subtrees  are  considered  as  */ 

/*  identical  if  cost  difference  <  EPS  */ 


begin ; 

/*  There  are  3  long  arrays:  */ 
/*  NODE. . • denotes  condition  test  at  root  of  optimal  */ 
/*  subtree.  Determines  the  number  of  (k-1) -trees  */ 
/*  this  k-tree  consists  of.  */ 
/*  LEFT. .. pointer  to  the  leftmost  (k-1) -tree.  */ 
/*  INDEX_INCR. . . the  difference  in  the  indices  of  the  */ 
/*  (k-1) -trees  in  the  short  (and  long)  arrays.*/ 
/*  When  considering  a  particular  partitioning  of  subcubes  */ 
/*  in  a  row  of  the  k-table,  the  row  of  the  corresponding  */ 
/*  (k-1) -cubes  can  be  found  with  the  vector  */ 
/*  FIRST  (0 : RULE_RANGE)  .  Analoguously  to  the  rule  numbers,  */ 
/*  a  unique  number  ir  0<i<RULE_RANGE,  is  assigned  to  each  */ 
/*  possible  combination  of  dashes.  FIRST (i)  gives  the  */ 
/*  index  of  the  first  subcube  of  this  dash  combination.  */ 
/*  The  COLUMN_DIFFERE NCE  can  be  determined  by  the  */ 
/*  dash  combination  and  the  dash  to  be  split  up.  */ 


/*  ALL_ZEROES  is  a  bit  vector  logically  connected  with 


*  / 
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/*  the  vector  FIBST.  If  the  actions  of  all  subcubes  in  a  */ 
/*  row  of  a  k- table  have  action  0,  ALL_ZEROES  is  on.  */ 
/*  This  means  that  any  combination  of  subcubes  of  this  row*/ 
/*  will  again  result  in  an  action  0  and  the  combining  */ 
/*  condition  has  to  be  tested.  (Tests  showed  that,  e.g.,  */ 
/*  for  eight  conditions  the  saving  in  conversion  time  is  */ 
/*  not  greater  than  10  percent).  */ 

/*  SHQRT_BASE,  SHOBT_ITOEX,  and  SHORT_HEXT  are  indices  */ 
/*  in  the  k-table,  which  indicate  the  begin  of  a  row*  a  */ 
/*  particular  k-cube  in  that  row, and  the  begin  of  the  next*/ 
/*  row,  respectively.  LONG_JBASE,  LONG_INDEX,  and  */ 
/*  L0UG_UEXT  are  the  adjusted  indices  in  the  long  arrays.  */ 


del  (gain (2, 0 : short_size)  ,prob (2, 0: short_size) )  float  bin; 
del  (action (2, 0 ; short_size) , node  (0; long_size) , 
lef  t  (rule_range-®- 1 ;  long__size)  , 
index__incr  (rule__range-e- 1 ;  long_size)  , 
first  (0:  rule_range)  ,  curr,prev)  fixed  bin  (15); 
del  (ali_zeroes  (0 :  rule_range)  ,all_zero,curr_all_zero)  bit  (1)  ; 
del  (1  on  g_base,  long_index  ,long_next  ,short_base,  shorty  index, 
short_next,prev_line,curr_line , column^ difference, 
column, prev_f irst , left__column,  dash_range, cube^action  , 
dash, action2)  fixed  bin  (15)  ; 
del  branch  fixed  bin(15)  init  (0)  ; 
del  (cube_gain, cube__prob)  float  bin; 
del  (f irst_call,additional_gain)  bit(1); 

/*  initialize  short  arrays  */ 

gain ( 1 ,*) =0; 
do  i-0  to  rule_range; 
prob  (1 ,  i)  =rule__prob  (i)  ; 
action  (1  ,i)  =rule_act ion_#  (i)  ; 
if  rule_action_#  (i)  >0 

then  node  (i) =-rule_action_# (i)  ; 
else  node(i)=0; 

end ; 

first  (*)  =0; 
all_zeroes  (*)  =•  0®  b; 

long_next=rule_range+1 ;  /*  points  to  first  1-cube  */ 

prev=2;  curr=1; 
do  k= 1  to  n; 

call  all_k_cubes;  /*  build  k-tables  of  increasing  k  */ 

end; 

call  code_matrix (Iong_next-1) ; 


all_k__cubes:  proc; 

/*  This  procedure  generates  a  row  in  the  k-table  for  all  */ 


/*  combinations  of  k  out  of  n  conditions.  */ 
/*  The  k-cubes  of  each  row  are  considered  in  */ 
/*  procedure  FXXEB_COMBXNATJON.  The  actual  combination  */ 
/*  of  conditions  is  stored  in  the  first  k  entries  of  */ 


-100- 


/*  COMB  (N)  .  NEXT__COMB  I  NATION  generates  the  next  of  the  */ 
/*  n  choose  k  combinations.  When  all  combinations  have  */ 
/*  been  enumerated,  END_COHB  is  set  true.  */ 

i=prev;  prev=curr;  curr=i ;  /*  exchange  PREV  and  CORE  */ 

short_next=0 ; 
end_comb=*  0*  b; 
do  i=1  to  k; 


comb  (I) =i;  /*  initial  combination  1,2,...k*/ 

end; 

do  while  (-»end_coab)  ; 

call  f ixed_combination ; 
call  next_combi nation ; 
end; 

end  all_k_cubes; 


fixed_combination :  proc; 

/*  This  procedure  finds  the  optimal  partitions  of  k-cubes  */ 
/*  in  a  row  of  the  k-table.  There  are  k  possible  ways  to  */ 
/*  combine  the  k-cubes  from  (k-1) -cubes  by  choosing  one  of*/ 
/*  the  k  dashed  conditions  as  the  combining  condition.  */ 
/*  Procedure  SPLIT_DASH  is  called  k  times  to  consider  one  */ 
/*  particular  split  for  all  k-cubes  in  the  row.  The  first  */ 
/*  time  SPLIT_DASE  is  called  for  these  k-cubes,  the  */ 

/*  probabilities  and  actions  have  to  be  determined.  */ 

short_base=short_next ; 
long_base=long_next; 
curr_line=0 ; 
do  i=1  to  k; 

cur r_Iine=curr_ linear ad ix (comb (i) )  ; 
end; 

curr_all_zero= 8 1 1 b ; 
first (curr_line)  =short_base ; 
dash_range=rule_range+1 ; 
do  i=  1  to  k; 

dash_r ange=  dash_range/cond_ range (comb (i) ) ; 
end; 

short_next=short_next+dash_range ; 
long_next=long_next+dash__range ; 

/*  If  ALL_ZEROES  of  the  row  in  the  (k-1) -table 
/*  is  on,  all  k-cubes  will  again  have  action  0  and  the 
/*  combining  condition  will  have  to  be  tested, 
f  irst__cali=8  1 8  b; 
do  1=1  to  k; 
dash=comb (1)  ; 

all __zero=all_ze roes  (curr_line- radix  (dash) )  ; 
call  spiit_dash ; 
f irst_cail=* 0*  b ; 
end; 

ail_zeroes  (curr_line)  =curr_all_zero; 
end  f ixed_combination ; 


*/ 

*/ 

*/ 


-101- 


split_dash:  proc; 

/*  This  procedure  calculates  the  cost  of  a  particular  */ 
/*  partition  of  all  k-cubes  in  a  line  of  the  k-table.  */ 
/*  If  FIRST_CALL  is  on*  in  addition  the  action  and  probab. */ 
/*  of  each  of  these  k-cubes  is  determined.  DASH  is  the  */ 
/*  condition  split  up.  */ 
/*  NODE  {*}  * LEFT  (*) *  and  INDEX_INCR  (*)  define  the  optimal  */ 
/*  subtrees.  In  NODE ( *)  the  condition  test  at  the  top  of  */ 
/*  an  optimal  subtree  is  stored.  However*  if  the  action  */ 
/*  of  a  subtree  is  >0*  the  subtree  can  be  replaced  by  */ 
/*  its  action  itself.  This  will  be  indicated  by  storing  */ 
/*  the  negative  action  number  in  NODE(^).  LEFT  (*)  points  */ 


/*  to  the  leftmost  optimal  (k-1) -length  subtree.  The  others/ 
/*  subtrees  can  be  located  with  INDEX_INCR  (*) .  In  the  case*/ 
/*  where  all  (k-1) -length  subtrees  have  an  action  -1  */ 

/*  except  one  which  has  an  action  0*  we  set  NQDE(*)=0  and  */ 
/*  LEFT  (*)  points  to  the  subtree  with  action  0.  BRANCH  is  */ 
/*  used  to  identify  this  subtree.  */ 

prev_line=curr_lin e-radix  (dash)  ; 
prev_f irst=first fprev_line)  ; 
column_dif ference=1 ; 
ii=k; 

do  i=n  by  -1  to  dash; 
if  i>combfii)  then 

column_difference=column-diff erence*cond_range (i)  ; 
else  ii=ii-1; 
end; 

long_index=long_base; 
short_index=short__base ; 
left_coiu®n=G ; 

do  while (left_column<dash_range*cond_range  (dash) )  ; 

do  column=left_ column  to  lef t_column+column__dif f erence- 1 ; 
if  f irst_call 1  action  (curr* short_index) -0  then  do; 
additional_gain=-*all_zero; 

if  cond_range (dash)  =2  then  do;  /*  limited  entry  */ 
ii=prev_f irst*  column; 
i=ii*column_difference; 
cube__gain=gain  (prev*ii)  +gain  (prev*  i)  ; 
if  first_call&^all_zero  then 

prob (curr*short_index) =prob (prev*ii) +prob(prev, i) ; 
if  -<>al!_zero 
then  do; 

/*  determine  cube_action  according  to  Fig.  2.5  */ 
cube_action=action (prevail) ; 
action2=:action  (pr@v*i)  ; 
if  action2=-1  then  branch=ii; 
else 

if  cube__>action=-1 

then  do;  branch=i;  cube_action=action2 ;  end; 
else 

if  cube__action=0  then  additional_gain=®  0®  b; 
else 
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if  action2=0 
then  do; 

cube_action=0;  additional_gain=f 0*b ; 
end ; 
else 

if  cube_action=action2  then; 
else  do; 

additional_gain=*  0*  b;  cube_action=0  ; 
end; 

end ; 

else  cube_action=0; 
end; 

else  do;  /*  extended  entry  */ 

ii=prev__f  irst+column ; 
cnbe_gain=gain (prev,ii)  ; 
do  i=2  to  cond_range (dash) ; 
ii=ii+column_diff erence ; 
cube_gain=cube_gain+gain (prev,ii)  ; 
end; 

ii=prev_f irst+ column; 
if  f irst_call&-»all_zero 
then  do; 

cnbe_prob=prob  (prev,  ii)  ; 
do  i=2  to  cond__range  (dash)  ; 
ii=ii*column_dif f erence; 
cnbe_prob=cube_prob+prob (prev,ii)  ; 
end; 

prob  (curr, snort_index) =cube_prcb; 
ii=prev_f irst+column ; 
end ; 

if  -*all_zero 
then  do; 

/*  determine  cube_action  according  to  Fig,  2.10  */ 
cube_action=action (prey ,ii)  ; 
if  cube_action=0  then  branch=ii; 

do  i=2  to  cond_range (dash)  while  (additional__gain)  ; 
ii=ii+column_dif ference; 
action2=act ion (prev ,ii)  ; 
if  action2=0  then  branch-ii; 
if  action2=-1  then; 
else 

if  cube_action=- 1  then  cube_action=action2 ; 
else 

if  cube_action=0 j action 2=0 
then  do; 

cube_action=0 ;  addit ional_gain= 1 0 1 b ; 
end ; 
else 

if  cube_action= action 2  then; 
else  do; 

additional_gain=* 0®  b;  cube_act ion=0 ; 
end; 

end; 
end ; 
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el  se  cube_act ion=C ; 
end ; 

if  additional^  a  in 

then  cube_gain=cube_gain 

+cond_cost (dash) *prob (curr,short_index)  ; 

if  f irst__call 
then  do; 

action (airr„ short_index) =cube_action; 
if  cube_action-9=0  then  curr_all_zero=8  0  ®b ; 
end; 

if  f  irst_call|  cube_gain>gain  (curr  ?short_index)  -a-eps 
then  do; 

gain  (curr , short_index)  =cube_gain; 
index_incr (long_index)  =column_di£ f erence; 
if  cube__action>0 
then  do; 

node  (long_index)  =-cube_action ; 
left  (long_index)  =prev_f  irst-a-column-s-ad  just  (k)  ; 
end; 
else 

if  additional_gain 
then  do; 

node (long_index)  =0; 
left  (long_index)  =  branch  ^adjust  (k)  ; 
end ; 

else  do; 

node  (long_index)  =dash ; 

left  (long_index)  =prev_f irst-^coluin-s-ad  just  (k)  ; 
end; 

end; 

end; 

short_index=short_index+ 1 ; 
iong_index=long_index+1 ; 
end  ; 

lef t_c olumn=le£ t_column 

-s-column^diff  erence^c  cnd_range  (dash)  ; 

end; 

end  split_dash; 


code__matrix:  proc  (root)  ; 

/*  This  procedure  extracts  the  optimal  tree  from  the  long  */ 
/*  arrays  traversing  the  tree  in  preorder.  Preorder  */ 
/*  traversing  is  done  recursively  in  the  following  way:  */ 
/*  (1)  Visit  root.  Assign  next  line  in  code_matrix  to  this3**1/ 
/*  node.  Insert  TEST (*) .  */ 
/*  (2)  Traverse  subtrees  from  left  to  right.  Boot  of  */ 
/*  subtrees  are  determined  by.  LEFT  and  INBBX_INCR.  */ 
/*  Pointers  in  TREE  to  the  nodes  are  inserted  as  soon  */ 
/*  as  line  for  successor  node  is  assigned. If  successor*/ 
/*  node  of  i  is  a  leaf  no  line  is  assigned. Instead  the*/ 
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/*  action  is  stored  in  TKEEfi,*)  with  a  negative  sign.*/ 

del  (root,i, jj)  fixed  bin(15); 
del  1  stack  (0  ;  n)  , 

2  long  fixed  bin  (15)* 

2  value  fixed  bin  (15), 

2  line  fixed  bin(15)  ; 
del  (index,cffi__index)  fixed  bin(15)  ; 
total__cost=sum  (cond_cost)  -gain  (curr,0)  ; 
long_index=root ; 
index=0; 
csa_ind@x=0 ; 
stack. value (0)  =0; 
if  node (root) <=0 
then  do; 
test  (1)=0  ; 

#_nodes=1 ; 
return; 
end ; 

do  while  ( 8 1 • b)  ; 

if  node  (long_index) >=0&long_index>rule_range 
then  do; 

if  node (long_index)  >0 
then  do; 

index=index* 1 ; 
cm_index=cm_index* 1 ; 
stack. long (index) =long_index ; 
stack. value (index)  =0; 
stack. line (index)  =cm_index; 
if  index>1 
then 

tree  (stack,  line  (index-1)  , stack,  value  (index-  1) ) 
=caa__index; 

test  (cm__index)  =node  (long_index)  ; 

end ; 

iong_index=ief t  (long_  index)  ; 

end; 

else  do; 

tree (stack. li ne (index) , stack. value (index) ) 

=node  (long__index)  ; 
do  while  (stack. value  ( index)  >= 

ccnd_ran  ge  (test  (stack,  line  (index)  ) )  -  1)  ; 
index=index-1 ; 
if  index=0 
then  do; 

#_jnodes=cni_index ; 
return ; 

end; 

end ; 

stack. value  (index) =stack. value (index)  +1 ; 
long_index=lef t (stack. long (index) ) 

♦stack. value (index) *index_incr (stack. long (index) ) ; 

end ; 
end; 

end  code_matrix; 
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end; 

next_combination:  proc; 

/*  This  procedure  generates  another  combination  of  */ 

/*  k  out  of  n  conditions.  The  combination  is  stored  in  the#/ 
/*  first  k  entries  of  vector  COMB  (N) .  END_COMB  is  set  true#/ 
/*  as  soon  as  all  combinations  have  been  enumerated.  */ 

del  (i,j)  fixed  bin(15); 

del  ok  bit  (1)  ; 

j=k; 

comb  ( j)  =comb  ( j)  +1 ; 
if  comb(j)>n 
then  do; 
ok=*  0 0 b; 
j=j-1 ; 

do  while  (-»ok&j>0)  ; 
comb  ( j)  =comb  (j)  +1 ; 
do  i=  j v 1  to  k; 

comb  (i)  =comb  ( j)  +  i- j ; 
end ; 

if  comb  (k)  <=n  then  ok= 1  1 1  b ; 
else  j=j-1; 
end; 

if  -*ok  then  end_comb=  *  1  *  b ; 
end ; 

end  next_combinat ion ; 
end 
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Appendix  B 


Storage-Minimal  Conversion  of  Mixed-Entry  Decision  Tables 
Including  Action  Hoisting 


/*  This  algorithm  converts  a  mixed-entry  decision  table  */ 
/*  to  a  decision  tree  of  minimum  storage  requirement.  */ 
/*  Given  the  costs  of  each  condition  test  and  each  action  */ 


/*  the  sum  of  the  storage  costs  of  all  condition  tests  and*/ 
/*  actions  in  the  decision  tree  to  be  derived  is  minimal.  */ 
/*  The  number  of  conditions  that  can  be  handled  with  this  */ 
/*  version  is  limited  to  9.  The  program  may  be  modified  */ 
/*  in  order  to  handle  up  to  12  conditions.  */ 
/*  It  is  assumed  that  the  order  in  which  actions  are  to  be*/ 
/*  performed  is  immaterial.  The  number  of  actions  that  can*/ 
/*  be  handled  by  this  program  is  limited  to  14.  On  the  */ 
/*  expense  of  more  storage  requirement  it  may  be  easily  */ 
/*  modified  to  handle  up  to  30  actions.  */ 

/*  The  decision  table  has  to  be  passed  from  the  calling  */ 
/*  program  in  expanded  form.  If  the  ELSE  rule  is  tested,  */ 
/*  a  unique  action  is  to  be  chosen  as  the  action  to  be  */ 
/*  performed  as  the  ELSE  rule.  This  program  does  not  */ 
/*  distinguish  between  this  ELSE  rule  action  and  any  other*/ 
/*  action.  For  each  elementary  rule  i  a  string  */ 
/*  RULE_ACTION  (i)  of  16  bits  has  to  be  specified.  Bit  1  */ 
/*  has  always  to  be  on  (since  ve  want  to  be  consistent  */ 
/*  with  the  output  where  this  bit-string  has  to  represent  */ 
/*  a  negative  number) .  Bit  2  indicates  whether  the  rule  is*/ 
/*  logically  impossible.  In  this  case  all  bits  have  to  be  */ 


/*  set  to  1.  Bits  3  to  16  correspond  to  up  to  14  different*/ 


/*  actions.  #_ACTIONS<= 14  specifies  the  number  of  */ 
/*  different  actions  used  (only  bit  3  to  bit  (#_actions+2)  */ 
/*  are  used  in  the  program)  .  */ 

/*  The  decision  tree  is  returned  in  form  of  a"code  matrix"*/ 
/*  which  is  a  set  of  arrays.  Each  node  of  the  decision  */ 
/*  tree  is  represented  as  one  line  of  the  arrays.  The  */ 
/*  first  entry  in  line  i,  TEST (i)  ,  specifies  the  condition*/ 
/*  to  be  tested  at  this  node.  ACTI0N_H0ISTED (i)  is  a  bit  */ 
/*  string  which  specifies  the  actions  which  have  to  be  */ 
/*  performed  immediately  before  testing  the  condition  of  */ 
/*  the  node.  Bit  1  is  always  on,  bit  2  always  off.  For  */ 
/*  each  possible  outcome  x  of  the  condition  test,  0<=x<=  */ 


/*  range  (condition  test)-1,  an  entry  points  to  the  line  of*/ 
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/*  the  node  which  has  to  be  visited  next  in  case  of  x.  If  */ 
/*  no  other  node  has  to  be  visited?  the  entry  is  negative  */ 
/*  and?  using  the  UNSPEC  built-in  function?  the  entry  can  */ 
/*  be  interpreted  as  a  bit  string.  Again?  bit  3  to  bit  16  */ 
/*  specify  the  actions  that  have  to  be  performed.  Bit  3  to*/ 


/*  bit  16  may  all  be  zero.  */ 

/*  #_NODES  will  give  the  number  of  nodes  in  the  decision  */ 
/*  tree.  The  arrays  TEST? ACTION^ HOISTED?  and  TREE  have  to  */ 
/*  be  allocated  sufficiently  large.  An  upper  bound  for  */ 
/*  #_NODES  is  the  maximum  number  of  internal  nodes  of  a  */ 
/*  complete  decision  tree  with  conditions  of  the  given  */ 
/*  ranges.  */ 
/*  TOTALjCOST  returns  the  storage  cost  of  the  decision  */ 
/*  tree  derived.  */ 

/*  Example .  Passing  the  decision  table  of  Fig.  3.1?  we  get*/ 
/*  the  following ■ code_matrix  (the  trailing  zeroes  of  the  */ 
/*  bit  strings  are  not  printed) •  */ 


/* 

/* 


action 


/* 

/* 

/* 

1  i  ! 

testf 

hoisted 

1 

tree  (0) 

1 

tree  (1) 

2 

tree  (2)  \ 

.  . . a 

*/ 

*/ 

V 

i  i  i 

2  f 

1000000 

! 

2 

1 

5 

1 

y 

I 

/* 

!  2  | 

3  1 

1000000 

s 

3 

1 

4 

1 

1 

*/ 

/* 

!  3  ! 

1  I 

1010010 

1 

1000001 

1 

1111111 

1 

1001000  ! 

*/ 

/* 

1  Si  I 

1  1 

1000000 

1 

1111111 

1 

1000001 

i 

ioooioo  i 

*/ 

/* 

i  5  t 

3  | 

1000000 

1 

1 001000 

1 

6 

1 

i 

V 

/* 

I  6  i 

1  s 

1010000 

1 

1001010 

1 

1000010 

1 

1111111  1 

*/ 

/* 

a _ 

_ _ _ fi 

*/ 

*/ 

*/ 


/*  TOTAL_CQST  =61.0.  */ 

/*  The  tree  corresponding  to  this  code  matrix  is  shown  in  */ 
/*  Fig.  3.4.  Traversing  that  tree  in  preorder  yields  */ 
/*  this  code  matrix.  */ 


/*  Using  the  PL/1  Optimizer  Compiler  for  compilation  and  */ 
/*  an  IBH/370-165-II  for  execution?  the  average  CPU  time  */ 
/*  recorded  for  a  number  of  sample  tables  was  as  follows:  */ 

/*  t - — — - - - - - ______ - Q  */ 

/*  f#  of  conditions!  5  6  7  8  9  \  */ 
/*  'I#  of  actions  f  10  12  13  13  13  |  */ 
/*  J CPU  time  (secs) ?  0.12  0.31  0.9  2.7  9.5  fl  */ 

/#  6 _ _ _ _ _ _ _ B  */ 

/*  Limited-entry  decision  tables  with  eight  conditions  */ 
/*  can  be  run  in  a  200K  bytes  region.  For  tables  with  */ 
/*  twelve  conditions  an  address  space  of  about  7K  bytes  */ 
/*  is  required.  */ 
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storage_minimal:  proc (n, #_act ion s,c on d_r a nge, conduces t, 

act  ion_cost  ,rule_action,  #_n  odes, 
test, action_hoisted, tree, total_cost) 
reorder; 

del  (n,#_actions,  cond_range  (*)  ,#_nodes,test  (*)  ,tree  (*,*) ) 
fixed  bin  (15) ; 

del  (cond_cost  {*)  ,action_cost  (*) ,total_cost)  float  bin; 
del  (rule_action  (*)  ,action_hoisted  (*) )  bit(*); 
del  (long_size, ad  just (n) , rule_range, comb (n) , radix (n)  , 
i, ii, j, j j,k, 1)  fixed  bin(15); 
del  (ok,end_comb,  f  irst_call)  bit(1); 
del  eps  float  bin; 


/*  determine  the  greatest  rule  number  (RULE_RANGE)  */ 

rule_range=1 ; 
do  i=n  to  1  by  -1 ; 

rad  ix  (i) =rule_range ;  /*  multiplier  of  i-th  condition*/ 

rule_range=rule_range*cond_range (i)  ; 
end; 

rule_range=rule_r ange- 1 ; 


/*  determine  long__size 
adjust  (1)  =0 ; 
adjust (2)  =rule_range+1 ; 
do  i=1  to  n-2; 


k=n-i; 

adjust  (i-6-2)  =0 ; 
do  j=1  to  k; 

comb  ( j)  =  j  ; 
end ; 

end_comb=1 0 8  b; 
do  while  (-»end_comb)  ; 

11=^; 

do  j=1  to  k; 

j  j=  j  j*cond_range  (comb  ( j) )  ; 
end ; 


/*C0KB (*)  holds  one  of  n  choose 
/*  combinations  of  conditions 
/*  EUD_CCMB  is  true  if  all 
/*  combin.  have  been  enumerated 


adjust  (i+2)  =ad  just  (i+  2)  «■  j  j ; 
call  next_combination ; 
end ; 
end; 

long_size=sum  (adjust)  +sum  (cond__range)  ; 

/*  ADJUST (*)  contributes  only  the  number  of  k-cubes 
/*  with  k<n-2.  For  k=n- 1  there  are  sum  (COND_SANGE) 
/*  k-cubes. 

eps=  1 .  e- 6*  (sum  (cond_cost)  +sum  (action_cost) )  ; 

/*  subtrees  are  considered  as  identical  if  costs 
/*  differ  in  less  than  eps 


*/ 


k*/ 

*/ 

*/ 

V 


*/ 

V 

*/ 

*/ 

*/ 


begin ; 

/*  For  all  subcubes  the  optimal  partitions  and  the  actions*/ 
/*  to  be  hoisted  above  the  corresponding  subtree  have  to  */ 
/*  be  saved  until  the  end  of  the  algorithm.  As  in  the  */ 
/*  program  in  Appendix  A,  we  will  call  the  arrays  */ 
/*  containing  this  information  long  arrays  and  their  size  */ 
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/*  LONG_SIZE  with  */ 

/*  LONG_SIZE=SUM  (number  of  k-cubes) .  */ 

/*  k  */ 

/*  The  long  arrays  are:  */ 

/*  NODE. .. denotes  condition  test  at  root  of  optimal  */ 

/*  subtree.  Determines  the  number  of  (k-1) -trees  */ 

/*  this  k-tree  consists  of.  */ 

/*  LEFT. . . pointer  to  the  leftmost  (k-1) -length  subtree.  */ 
/*  INDEX_INCR ...  the  difference  in  the  indices  of  the  */ 

/*  (k-1)  -length  subtrees  in  the  short  (and  */ 

/*  long  arrays) .  */ 

/*  ACTION ...  bit  string  of  length  16.  Bit(1)  corresponds  */ 
/*  to  SAM E_ ACTION  in  algorithm  of  Section  3.2.  */ 

/*  All  bits  are  on  if  EXCLUDABLE  is  TRUE.  Bits  3  */ 

/*  to  16  correspond  to  actions  1  to  14.  */ 

/*  Although  cost  may  be  a  short  array  (like  gain  in  App.A)*/ 

/*  it  was  designed  as  a  long  array  in  this  program.  */ 

/*  Allocating  two  short  arrays  instead  of  one  long  array  */ 
/*  for  COST  could  save  up  to  20  percent  storage  for  very  */ 
/*  large  number  of  conditions.  */ 

/*  When  considering  a  particular  partitioning  of  subcubes  */ 
/*  in  a  row  of  the  k-table,  the  row  of  the  corresponding  */ 
/*  (k-1) -cubes  can  be  found  with  the  vector  */ 

/*  FIRST (0:EULE_RANGE) .  Analoguously  to  the  rule  numbers*  */ 
/*  a  unique  number  i,  0<i<RULE_JRANGE,  is  assigned  to  each  ♦/ 
/*  possible  combination  of  dashes.  FIRST (i)  gives  the  */ 

/*  index  of  the  first  subcube  of  this  dash  combination.  */ 
/*  The  COLUMN^ DIFFERENCE  can  be  determined  by  the  */ 

/*  dash  combination  and  the  dash  to  be  split  up.  */ 

del  (cost  (0:  long_size)  ,cube__cost)  float  bin; 

del  (node (0:long_size) ,left (rule_range+1 : long_size)  , 

index_iner  (rule_range-e- 1 :  long_size)  *  first  (0  :ruie_range)  * 
long_next, long_base, long_index  *  pre v_line , cur r_line , 
column, column__dif  fer  ence,  prev_first,  left_column,  dash , 
dash_range,  #_subtrees)  fixed  bin  (15); 
del  branch  fixed  bin  (15)  init  (0)  ; 
del  (cur  reaction ,  action  (0  :long_size) )  bit(16); 
del  bits  (16)  static  bit  (16)  init  ( 

« 1 00000000  0000000 «b, *  0100000000  000000 «b, 

9  001 0000000000000 8 b,  9  0001 000000000000®  b, 

*  0000100000000000«b, 80000010000000000®b, 

•  0000001 000000000 8 b, 9  0000000 100000000 8 b, 

9  0000000010000000 9 b, *  0000000001 000000 9 b, 

8  000000000010  0000 «b,  9  00000000  0001 0000* b, 

»  0000000000001000* b, 8  0000000000 0001 00 9b, 

8  0000000000000010* b, 8  0000000000000001  »  b)  ; 
del  excludable  static  bit  (16)  init  (•  1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1  * b)  ; 
del  same_action  bit(16)  init  (e 1000000000000000s b)  ; 

V 


/*  initialize  short  arrays 
do  i=0  to  rule_range; 
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action  (i) =rule_action (i) ; 
node  (i)  =- 1 ; 
cube_cost=0 ; 

if  action  (i)  -»=excludable 
then  do  j=1  to  factions; 
if  action  (i)  &bits  (j  +  2) 

then  cube_cost=cube_cost+action_cost ( j) ; 

end ; 

cost  (i) =cube_cost; 
end; 


f  irst  (*)  =0  ; 

iong_next=rule_range-*- 1  ;  /*  points  to  first  1-cube  */ 

do  k= 1  to  n; 

call  all_k_cubes;  /*  build  k-tables  of  increasing  k  */ 

end; 

call  code_matrix (long_next-1) ; 


all_k_cubes:  proc; 

/*  This  procedure  generates  a  row  in  the  k-table  for  all  */ 


/*  combinations  of  k  out  of  n  conditions.  */ 
/*  The  k-cubes  of  each  row  are  considered  in  */ 
/*  procedure  FIXED_COMBINATION.  The  actual  combination  */ 
/*  of  conditions  is  stored  in  the  first  k  entries  of  */ 
/*  COMB  (N) .  NEXT_COMBI NATION  generates  the  next  of  the  */ 
/*  n  choose  k  combinations.  When  all  combinations  have  */ 
/*  been  enumerated,  END__C0MB  is  set  true.  */ 


end_comb= 1  O' b; 
do  i=1  to  k; 

comb(i)=i;  /*  initial  combination  1,2r...k*/ 

end; 

do  while  (-«end_comb)  ; 

call  f ixed_combination ; 
call  next_combination ; 
end; 

end  all_k_cubes; 


f ixed_combination :  proc; 

/*  This  procedure  finds  the  optimal  partitions  of  k-cubes  */ 
/*  in  a  row  of  the  k-table.  There  are  k  possible  ways  to  */ 
/*  combine  the  k-cubes  from  (k-1) -cubes  by  choosing  one  of*/ 
/*  the  k  dashed  conditions  as  the  combining  condition.  */ 
/*  Procedure  SPLIT_DASH  is  called  k  times  to  consider  one  */ 
/*  particular  split  for  all  k-cubes  in  the  row.  */ 

long_base=long_next; 
curr_line=0 ; 
do  i= 1  to  k; 

cur r_line=curr_line+radix (comb (i) )  ;  /*  index  in  first  */ 
end; 

first  (curr_line)  =long_base; 
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dash_range=rule_range* 1 ; 
do  i=1  to  k; 

dash_j:ange=dash_range/cond_range {comb (i) ) ; 
end; 

long_next=long_ne  xt+dash_range ; 
f  irst__cali=®  1  ®b; 
do  1=1  to  k; 
dash=coib(l) ; 
call  split_dash; 
f irst_call= *  0  ®  b ; 
end; 

end  f ixed_combination ; 


split_dash:  proc; 

/*  This  procedure  calculates  the  cost  of  a  particular  */ 
/*  partition  of  all  k-cubes  in  a  line  of  the  k-table.  */ 
/*  DA.SH  is  the  condition  split  up.  */ 
/*  NODE  (*)  ^LEFT  (*)  9  and  INDEX_INCE  (*)  define  the  optimal  */ 
/*  subtrees.  In  NODE(*)  the  condition  test  at  the  top  of  */ 
/*  an  optimal  subtree  is  stored.  However,  if  all  rules  */ 
/*  comprised  by  a  k-cube  have  identical  action  sets*  this  */ 
/*  will  be  indicated  by  storing  the  negative  condition  */ 
/*  number  in  NODE  (*)  .  LE?T(*}  points  */ 
/*  to  the  leftmost  optimal  (k-1) -length  subtree.  The  others/ 
/*  subtrees  can  be  located  with  INDEX_INCR (*) .  In  the  case*/ 
/*  where  all  (k-1) -length  subtrees  have  an  action  -1  */ 
/*  except  one  which  has  an  action  0,  we  set  NGDE(*)=0  and  */ 
/*  LETT  (*)  points  to  the  subtree  with  action  0.  BRANCH  is  */ 
/*  used  to  identify  this  subtree.  */ 


prev_line=curr__line-radix  (dash)  ; 
prev_f  irst=f irst  (prev__line)  ; 
column__dif  ference=1 ; 
ii=k; 

do  i=n  by  -1  to  dash; 
if  i>coib{ii)  then 

column_dif £erence=column_diff erence*cond_range (i)  ; 
else  ii=ii-1; 
end; 

long_index=long_base; 
left_column=0 ; 

do  while  (left__column<dash__range*cond__range  (dash) )  ; 

do  column=lef t_column  to  left_coluan+column_dif  ference- 1 ; 
if  first_call 
then  do; 

j j=prev_f irst  -e-column; 
cube_cost=cost ( j  j)  ; 
curr_action=action  ( j  j)  ; 
if  curr_action-»=excludable 
then  do; 
branch=j j ; 

#__subtrees=1 ; 
end ; 
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else  #_subtrees=0 ; 
do  i=2  to  cond_range  (dash) ; 
j j= j j+column_difference ; 
if  action  (jj)  -^excludable 
then  do; 

cube_cost=cube_cost+cost ( j j)  ; 
branch= j j; 

#_subtrees=#_subtrees*1 ; 
if  curr_action=excludable 

then  curr_action=action ( j j) ; 
else  if  curr_action-»=action  ( j  j) 

then  curr_action=curr_action&action ( j j) 

&-«same_action ; 

end ; 

end; 

index_incr  (long_index) =column_dif f erence; 
action  (long_index)  =curr_action ; 
if  curr_action=excludable 
then  do; 

cost  (long_ index) =0 ; 
node (long_index) =-dash; 
end ; 
else 

if  curr_action&same_action 
then  do; 

cost  (long_index) =cost (branch) ; 
node  (long_index) =-dash; 
left  (long_index) =branch; 
end; 
else 

if  #_subtrees=1 
then  do; 

cost (long_index)  =cost (branch) ; 
node (long_index)  =0; 
left (long_index)  =branch; 
end ; 

else  do; 

if  curr_action-»=f  000000  0000000000  1  b 
then  do  i=1  to  #_actions; 
if  curr_action&bits (i+2) 
then  cube_cost=cube_cost 

-  (#_subtrees-1)  *action_cost (i)  ; 

end; 

cost (long_index) =cube_cost+cond_cost (dash) ; 
node  (long_index) =dash ; 
left  (long_index) =prev_f irst+column; 
end; 

end; 

else 

if  node  (long_index)  >0 
then  do; 

j j=prev_first+column; 
cube_cost=cost ( j j) ; 
if  action(  j  j) -*=excludable 
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then  do? 

#_subtre@s= 1 ; 
branch= j j; 
end? 

else  #_subtrees=0 ; 
do  i=2  to  cond_range  (dash)  ; 
j j=j j+column_difference; 
if  action  ( jj)  -^excludable 
then  do; 

cube_cost=cube_cost+cost ( j j)  ; 
branch= j j ; 

#_subtrees=#_subtrees+1 ; 
end ; 

end ; 

if  #_subtrees> 1 
then  do; 

if  action  f Ion g_ index)  -»=•  0000000000000000  sb 
then  do  i=1  to  tractions; 

if  action (long_index)  Sbits (i+2) 
then  cube_cost=cube_cost 

-(#_  snbtrees-1) *action_cost (i) ; 

end; 

cube_cost=cube_cost+cond_cost (dash)  ; 
end; 

if  cube_cost<cost (long_index)  -eps 
then  do; 

cost  (iong_index) =cube_cost; 
index_incr  (long_index) =column_dif f erence ; 
if  #_subtrees=1 
then  do; 

node  (long_index) =0; 
left  (long_index) = branch ; 
end; 

else  do; 

node (long_index)  =dash ; 
left  (long_index)  =  prev__f  irst+column; 
end ; 
end; 

end; 

long_index=long_index* 1 ; 

end ; 

lef  t_column=lef  t__column 

-§-coliimn_di£f  erence*ccnd_range  (dash)  ; 

end; 

end  split__dash; 


code_matrix:  proc (root)  ; 

/*  The  optimal  tree  is  extracted  from  the  long  arrays  and  */ 
/*  traversed  in  preorder.  Preorder  traversing  is  done  */ 
/*  recursively  in  the  following  way.  */ 
/*  (1)  Visit  root.  Assign  next  line  in  code_iaatrix  to  this*/ 
/*  node.  Insert  TEST  and  ACTION_HOISTED.  ~  */ 
/*  (2)  Traverse  subtrees  from  left  to  right.  Boot  of  */ 
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/*  subtrees  are  determined  by  LEFT  and  INDEX_INCR.  */ 

/*  Pointers  in  TREE  to  the  nodes  following  a  condition  */ 

/*  test  are  inserted  as  soon  as  line  for  successor  node  is*/ 

/*  assigned.  If  successor  of  node  i  is  a  leaf  (i. e.  no  */ 

/*  condition  test,  only  set  of  actions  is  to  be  performed)*/ 

/*  no  line  for  the  leaf  is  assigned.  Instead  the  set  of  */ 

/*  actions  is  stored  in  TREE  (i,*)  with  bit  1  on  which  can  */ 

/*  be  tested  later  in  order  to  determine  whether  the  entry*/ 

/*  in  TREE  is  a  pointer  to  another  node  or  describes  a  set*/ 

/*  of  actions.  */ 

del  (root  ,i,  j  ,k,l,  j  j)  fixed  bin(15); 
del  1  stack  (0:n) , 

2  long  fixed  bin(15), 

2  value  fixed  bin(15)  , 

2  line  fixed  bin  (15), 

2  actions  bit  (16); 
del  (index, cm_index)  fixed  bin(15); 
del  actions_done  bit (16); 
total_cost=cost (root)  ; 
long_index=root ; 
index=0 ; 

action s_done= *0000000 000000000* b; 
cm_index=0 ; 
stack. value (0) =0; 
if  node (root) <=0  then  do; 
test  (1)  =0 ; 

action_hoisted (1) =action (root)  ; 

#_nodes= 1 ; 
return ; 
end; 

do  while  ( *  1  *  b)  ; 

if  node  (long_index) >=0 
then  do; 

if  node (long_index) >0 
then  do; 

index=index+ 1 ; 

stack. long (index) =long_index ; 
stack. value (index) =0 ; 
cm_index=cm_index+ 1 ; 
stack. line (index) =cm_index; 
if  index>1 

then  tree (stack. line (index-1)  , stack. value (index-1 ) ) 
=cm_index; 

test  (cm_index) =node (long_index)  ; 
action_hoisted (cm_index) =action (long_index) 
&iactions_done \ same_action ; 
actions_done=action_hoisted (cm_index) |actions_done; 
stack. actions (index) =actions_done; 
end; 

long_index=left (long_index)  ; 
end ; 

else  do; 

if  action (long_index) =excludable 
then  unspec  (tree (stack. line (index)  , stack. value (index) )  ) 
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=excludable; 

else  unspec  (tree  (stack,  line  (index)  ,  stack,  value  (index) ) ) 

=action (long_index) S^actions^done 
|  sa®e__action ; 

do  while (stack. value (index) >- 

cond__range  (abs  (node  (stack,  long  (index)  )))-!)  ; 
index=index-1 ; 
if  index=0  then  do; 

#_nodes=c®_ index; 
return; 
end; 

act ions_done=s tack. actions (index)  ; 
long_index=stack. long (index)  ; 
end ; 

stack .value (index)  =stack. value (index)  +1 ; 
long_index=left (stack. long (index) ) 

-s-stack  .value  (index)  *ind@x_incr  (stack. long  (index) )  ; 

end; 
end ; 

end  code__matrix; 
end; 

next_combination:  proc; 

/*  This  procedure  generates  another  combination  of  */ 

/*  k  out  of  n  conditions.  The  combination  is  stored  in  the*/ 
/*  first  k  entries  of  vector  COMB  (N) .  END_COMB  is  set  true*/ 
/*  as  soon  as  all  combinations  have  been  enumerated.  */ 

del  (i,j)  fixed  bin(15); 
del  ok  bit  (1)  ; 

j=k; 

comb  ( j)  =comb  ( j)  +1 ; 
if  comb  ( j)  >n 
then  do; 
ok=®  0 • b; 

do  while  (-iokf>j>0)  ; 
comb  (j)  =comb  (j)  +1 ; 
do  i=j+1  to  k; 

comb  (i) =comb( j) +  i- j; 
end ; 

if  comb  (k) <=n  then  ok=®1®b; 
else  j=j-1; 
end; 

if  -*ok  then  end_comb=  8 1  •  b ; 
end ; 

end  next_combination ; 
end  storage_minimal; 
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